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Abstract 

We first review self-dual (chiral) gauge field theories by studying their Lorentz 
non-covariant and Lorentz covariant formulations. Then, we construct a non-Abelian 



self-dual two-form gauge theory in six dimensions with a spatial direction compactified 

m 

on a circle. This model reduces to the Yang-Mills theory in five dimensions for a small 
compactified radius R. This model also reduces to the Lorentz-invariant Abelian self- 
^> ■ dual two-form theory when the gauge group is Abelian. The model is expected to 



describe multiple 5-branes in M-theory. We will discuss its decompactified limit, 
covariant formulation, BRST-antifield quantization and other generalizations. 
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1 Introduction 



A self-dual gauge field theory (or a chiral gauge field theory) is defined as a 
p-form gauge potential whose p + 1 form field strength is constrained by the 
self-duality condition, which reduces physical degrees of freedom in a theory 
to the half of the case without the self-duality condition. If we consider our 
spacetime as the Lorentz signature, real self-dual gauge fields can exist only in 
4n+2 dimensions like in D=2, D=6 or D=10, which are the cases we consider 
in this thesis. Self-dual gauge field theories received huge attention for quite a 
long time because of their existence in various interesting theories. For exam- 
ples: They appear in the quantum hall effect and heterotic string theory. They 
also show up in the exotic six-dimensional 5-brane(s) worldvolume theory in 
M-theory, or in NS 5-brane(s) worldvolume theory in the type IIA string the- 
ory. Self-dual fields also appear in the ten dimensional type IIB supergravity 
too. However, this kind of theories are quite mysterious because of the lack of 
a standard action principle and subtle issues of the quantization on self-dual 
theories. Moreover, as we will see, people face even bigger challenges when 
trying to describe multiple M5-branes worldvolume theory, which is the main 
topic of this thesis (Based on [1]). 

As we know, string theories in ten dimensions can be unified by the eleven 
dimensional M-theory, where the basic objects are M2-branes and M5-branes 
(the magnetic version of M2-branes in the sence that M5-branes couple to the 
dual background three form C-field in 11D supergravity). One could consider 
that M-branes are the most fundamental objects we have. (For some recent 
review papers of M-theory branes, see [2]), and as a way to understand the 
mysterious nature of the M-theory, it is desirable to understand properties of 
these branes as much as possible. The description of a single M2-brane or a 
single M5-brane had already known for quite a long time, while the under- 
standing of multiple M2 branes gained ground in the past few years by BLG 
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and ABJM theory [3] [4]. It is interesting to start thinking about the question 
that how to describe multiple M5-branes. 

The physical degrees of freedom of the six-dimensional worldvolume theory 
of a M5-brane [5] consist of the so-called N = (2,0) tensor supermultiplet, 
which contains two-form gauge potentials with self-dual field strengths, five 
scalars, and two chiral spinors, where scalars and spinors can be interpreted 
as Goldstone bosons and fermions associated with broken translation sym- 
metries and supersymmetries. When the 11D M theory is compactified on a 
circle, it gives the 10D type IIA superstring theory Some of p-branes in the 
IIA theory have simple M-theory interpretations. In particular, wrapping one 
dimension of the M5-brane on the compact spatial dimension gives the IIA 
D4-brane theory. These D4-branes must arise as the dimensional reduction of 
the 6D five-brane world- volume theory. This is one of the criteria to construct 
M5-brane theory. Throughout this thesis, we will only focus on the gauge field 
sector, because the gauge field part brings the most subtle issues. 

Just like how the Maxwell fields (abelian gauge theory) in a single D-brane 
become the Yang-Mill fields (non-abelian gauge theory) when D-branes start 
to coincide. One expects that some kind of non-abelian 2-form gauge theory 
will be involved in multiple M5-branes. Although we expect that multiple M5- 
branes should be a non- Abelian theory, it might not be an simple non- Abelian 
gauge theory, because the entropy of coincident N M5-branes does not scale as 
A^ 2 like the Yang-Mills theory but rather scale as A" 3 [6]. In the case of mul- 
tiple M2-branes, it is also not an ordinary non- Abelian theory (the entropy of 
coincident N M2-branes scales as A" 2 ) ; it has the novel gauge symmetry based 
on the Lie 3-algebra. It is natural to ask whether similar structure plays a 
crucial role in multiple M5-branes. However, although there were approaches 
along this line, but it is not clear how they relate to M5-branes with the exis- 
tence of non-abelian chiral two-form gauge potentials [7]. 
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Some believed that a Lagrangian formulation for self-dual gauge theories 
was impossible, mainly because the self-duality condition imposes first order 
differential equations on the gauge potentials, while an ordinary kinetic term 
in a standard Lagrangian (take 2-form potentials in 6D as an example) 

L ~ H, vX H» vX ~ d { ,B vX] d»B vX (1) 

(where /i, v = 0, 1, 2, 3, 4, 5) always leads to a 2nd order differential equation. 
It turns out that the trick is to avoid using some of components of the gauge 
potentials, for example, components (where i,j = 0,1,2,3,4) will enter 
the action only up to surface terms. So even though we get 2nd order differen- 
tial equations from varying the action, the self-duality condition appears after 
integrating once the equations of motion. This trick was later generalized in [8] 
so that for a given spacetime dimension D 7 one can write down a Lagrangian 
for self-dual gauge fields for arbitrary divisions of D into two positive integers 
D' and D" : 

D' + D" = D (2) 

We call it as the (D f + D'^-formulation of self-dual gauge theories. 2 Hence 
the Lagrangian for a self-daul gauge field theory was first constructed without 
manifest Lorentz symmetry. Lorentz-covariant versions are possible only when 
introducing auxiliary fields [10, 11]. 

The gauge symmetry for a single M5-brane in the trivial background is 
Abelian. The first non-Abelian gauge theory for self-dual 2-form potentials 
was found when considering an M5-brane in a large C-field background. We 
call it as NP M5-brane theory, where "iVP" stands for "Nambu-Poisson". A 
Nambu-Poisson structure is used to define the non-Abelian gauge symmetry 

2 Some new non-covariant Lagrangians based on further decompositions of spacetime: D = Z?i +D2 + -D3 
are given in [9] 



5 



for the 2-form potential on a M5-brane. The physical origin of this Nambu- 
Structure is the coupling of open membranes to the C-field background [13]. 
The NP M5-brane theory was first derived from the BLG model [3]. Its gauge 
field content was further explored in [14, 15]. For a brief review about this 
topic, see [16]. 

A double dimension reduction of the NP M5-brane theory is in agreement 
with the lowest order deformation of the noncommutative D4-brane action in 
large NS-NS B field background [12]. Thus if this NP M5-brane theory can 
be properly deformed such that it agrees with the noncommutative D4-brane 
theory to "all orders", it might resemble the non-abelian structure of multiple 
M5-branes theory, since the multiple D4-branes theory is essentially a special 
case of the noncommutative D4-brane theory However, it turns out that it is 
extremely hard to deform the NP M5-brane theory [17]. We conclude that it 
takes brand new ideas to construct multiple M5-branes theory. 

In the literature, there has been various attempts to construct a non- 
Abelian gauge theory for 2-form gauge potentials B^ v . Taking values in a 
Lie algebra, the corresponding geometrical structures are called "non-Abelian 
gerbes". The immediate problem to construct such a model is that we need 
to define covariant derivatives to have gauge covaraint structures in a the- 
ory, thus we also need a 1-form potential A. For example, in [18], the gauge 
transformations of A and B are defined by 



where g G G is the gauge parameter and A G g is a 1-form. Mathematically 
such gauge transformations are well-defined and suitable to describe some 
systems such as the non-Abelian generalization of the BF model [19]. It is, 
however, not clear if it is relevant to describe multiple M5-branes. 



A' = gAg 1 + gdg 1 + A, 

B' = gBg- 1 + [A',A] A + dA + A A A, 



(3) 
(4) 
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Physically, the introduction of an extra field like A increases the physical 
degrees of freedom of the system. For the M5-branes system, there is no phys- 
ical degrees of freedom corresponding to any new field. Furthermore, with the 
addition of A, the field B is not a genuine 2-form potential in the sense that 
we can gauge away A by A, and then B is not independent of its longitudinal 
components. The result is similar to spontaneous symmetry breaking. On 
the other hand, if we consider that A does not have physical degrees of free- 
dom, it means that we might have a gauge symmetry to gauge it away. But 
this means that the covariant derivative in a theory become just d^. It will 
be problematic to define the non-abelian gauge transformation and the field 
strength of B in this gauge. 3 

Our goal here is to have a non-Abelian gauge symmetry which includes the 
Abelian theory as the special case when the Lie algebra involved is Abelian. 
This criterium is not matched by any existing construction in literatures. As- 
suming the existence of an action and gauge transformation laws, a no-go 
theorem [21] states that it does not exist any nontrivial deformation of the 
Abelian 2-form gauge theory. One of their assumptions was the "locality" for 
the action and the gauge transformation laws. In particular, Lorentz symme- 
try was not assumed. 

The non-existence of a local action for multiple M5-branes was argued in 
another way by Witten [22]. The M5-branes system is known to have confor- 
mal symmetry, which implies that upon double dimension reduction, the 4+1 
dimensional action should be proportional to J ofx^. On the other hand, the 
reduction of a 5+1 dimensional local action on a circle should give J d x 2n R 7 
which has the opposite dependence on R. As long as we assume a Lorentz- 

3 One attempt to construct non-Abelian 2-form gauge theory is to define it on the loop space [20]. This 
approach introduces infinitely many more degrees of freedom in a theory 
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covariant formulation for M5-branes without explicit reference to the com- 
pactifiation radius R except through the measure of integration, this gives a 
strong argument against the Lagrangian formulation of multiple M5-branes. 

Recently, there are proposals [23, 24] claiming that the multiple M5-branes 
compactified on a circle of finite radius R could be described by the U(N) 
super Yang-Mills (SYM) theory for N D4-branes even before taking the small 
R limit. This would be a duality between two theories in 5 and 6 dimen- 
sions, respectively, but it can not be viewed as an example of the holographic 
principle of quantum gravity, because there is no gravitational force in these 
theories. Their proposal, if correct, would be revolutionary, however we will 
point out its difficulties later. 

These developments suggest that it is already a tremendous progress to 
have a theory for multiple M5-branes compactified on a circle of finite radius 
R, if the following two criteria are satisfied: 

1. In the limit R — > 0, the theory should be approximated by the gauge field 
sector of the multiple D4-branes theory, which is the U(N) Yang-Mills 
theory in 5 dimensions. 

2. When the Lie algebra of the gauge symmetry is Abelian, the theory should 
reduce to N copies of the Abelian self-dual 2-form gauge field theory. 

In view of no-go theorems [21], the absence of 6 dimensional Lorentz sym- 
metry due to compactification of the 5-th direction does not really necessarily 
make the task easier. 4 In the following we will construct an interacting the- 
ory satisfying both criteria. The cost we have to pay to meet these criteria 
is a nonlocal treatment of the compactified dimension as we will see in the 
following sections. Such a description may seem exotic, but it might be justi- 

4 Notice that the 2nd criterion ensures the 6 dimensional Lorentz symmetry in the broken phase in the 
limit R — > oo. 



8 



fied in view of the special role played by the compactified direction in defining 
M-theory as the strong coupling limit of type HA string theory. 

It might be worthy of note that there are some recent works on non-Abelian 
two-form theory and M5-branes [26], but we will not be able to review them 
in this thesis. On the other hand, for a more general approach to self-dual 
field theories and has the advantage to deal with subtle topological issues, we 
refer to the work of Belov and Moore [28]. It will be interesting to relate the 
model in this thesis to their formulation. 

We organize this thesis as follows. 

In section 2, we start from the simplest example among self-daul field the- 
ories: the chiral boson in two-dimensions. We will argue that why some naive 
methods to construct a self-dual theory do not work. Then we discuss two 
approaches of the chiral boson action. We will see some universal figures 
in self-dual theories like an extra gauge symmetry and the modified Lorentz 
transformation law. 

In section 3, we will first introduce the standard 2-form potential gauge the- 
ory, and as an example, we briefly discuss the BF theory in four dimensions. 
Then we start to consider self-dual 2-form theory for a single M5-brane, which 
is so-called PS (Perry and Schwarz) formulation [29]. We will also study dif- 
ferent self-dual 2-form formulations under different spacetime decompositions. 

In section 4, we study Lorentz-covaraint versions of the chiral boson and 
the chiral 2-form with the help of introducing an auxiliary field, these are so- 
called PST (Pasti, Sorokin and Tonin) formulations. We will see how these 
covaraint actions reduce to previous non-covariant formulations by a gauge 
fixing condition. 
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In section 5, which is the body of this thesis, we formulate a non-abelian 
2-form theory. And we will non-abelianize PS action to see that it gives the 
proper action for multiple M5-branes. In particular, we will see how this model 
reduces to the Yang-Mills theory in 5 dimensions for small compactified ra- 
dius R and it reduces to the Lorentz-invariant theory of Abelian chiral 2-forms 
theory when the gauge group is Abelian. 

In section 6, the BRST transformation laws of this non-abelian 2-form 
gauge algebra are given. A crucial point is that we will need to introduce 
the ghost of the ghost for this kind of reducible system. A BRST invaraint 
gauge-fixed action is also given by utilizing the BRST-antifield method. 

In section 7, we generalize the theory to construct non- Abelian gauge the- 
ory for 3-form potentials. 

In section 8, we conclude this thesis by pointing out some difficulties when 
trying to find a manifest Lorentz-covariant formulation of the non-abelian 
self-dual 2-form theory by using similar ideas of introducing extra auxiliary 
fields. 
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2 A Toy Model: 2D Chiral Boson 



The simplest example for a self-daul field theory is in two-dimensions (2D), 
often called the chiral Boson, which plays an essential ingredient in the quan- 
tum Hall effect or the construction of heterotic-type string theory that is 
phenomenologically interesting because of the left-right asymmetry. 

In 2D, the anti-symmetric tensor is just a scalar <j) with field strengths 
defined by: 

F a = d a <f> (5) 

where a = 0, 1. There is a global symmetry for the scalar 

5(j) = constant (6) 

The self-duality condition is defined by: 

d (J) -3^ = ^ = (7) 

The first quesiton is: can we have an action that gives this self-duality condi- 
tion? First of all, let us learn something from making mistakes. If you want 
to write down an action that gives the self-duality constriant equation, the 
first nature approach that you might try is to introduce a Lagrange-multiplier 
field A to implement this constraint and write down the following action : 



S = Id x 



^F a F a + XT 



(8) 



indeed, the self-duality condition will be obtained by the variation of the ac- 
tion with respect to A. However, this method turns out to be wrong since the 
Lagrange multiplier term itself ends up generating an extra field equation that 
we do not need from the field equation of the scalar (f). 

A clever trick introduced by Siegel (1984) [30] was to consider the "squared 
self-duality contraint" in an action: 



S = / d 2 x 



h a F a + A(J-) 2 ] (9) 
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so that the field equation of Lagrange-multiplier field A still gives the self- 
duality condition: do4> — d\(j) = 0. The key difference here is that the field 
equation of (f) could be written as: 

(d + d 1 )J 7 -2X{d -d 1 )J 7 =0 {=0 ifJ 7 =0) (10) 

which does not give an extra constraint in the sense that it vanishes identically 
(a redundant equation of motion) by the self-duality condition! Furthermore, 
this redundant field equation occurs us the existence of an additional gauge 
symmetry in the theory. One could indeed find a gauge transformation that 
leaves the action invariant: 

5(f) = Tt. (11) 
5X = i(<% + di)e + e(d -<9i)A + A(<%-di)e. (12) 

with the gauge parameter e. However, although the above model shows that 
the Lagrange multiplier does not cause further constraints, people found Sigel's 
model suffers from the anomaly problems if not properly treat when quantized 
[32]. Furthermore, it is not totally clear whether there are enough local gauge 
symmetries in Seigel-like formulations in D = 6 case or D = 10 case to com- 
pletely gauge away Lagrange-multiplier fields [32]. Since the case D = 6 is of 
our the main topic, in the following we will introduce yet another formulation 
that could be generalized to higher dimensions and we will see the self-duality 
condition could be obtained by yet another interesting way rather than the 
squared constraint in the Seigel's formulation. 

The formulation of chiral boson we consider was invented by R. Floreanini 
and R. Jackiw (1987) [31]. The FJ action is 

Si+i = -i J d 2 x d x (J)(d t (f) - d x (J)) (13) 
where 1 + 1 means that the decomposition of 2D Minkowski space 

R 1+1 = R 1 x R 1 (14) 
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which is obviously the only possible decomposition in 2D. The salient property 
of this action is the existence of the following gauge transformation (assuming 
the surface term does not contribute): 

5<j> = f(t) (15) 

for an arbitrary function f(t) independent of x. We can check, since 

SS ~ J d 2 x d x ((pd t f(t)) = tot. (16) 

so that the action is indeed invariant up to a total derivative. Notice that 
this symmetry is different from the standard constant transformation. The 
equation of motion is: 

d x {d x <f> - d t <t>) = (17) 

this implies 

(d x <f> - dt<f>) = git) (18) 

for an arbitrary function g(t) independent of x. Thus we find that if we can 
use the gauge transformation by considering 

/(*) = - f dyg(y) (19) 

we can absorb the function g(t) to obtain the self-duality condition: 

d x $ -dt<f> = (20) 

On other other hand, one notices that the FJ action is not manifestly Lorentz 
invariant, but an interesting property is that the action is invariant under a 
modified Lorentz transformation law: 

5(f) = X tx {td x - xdt)<f> + X^xidtcj) - d x 4>) (21) 

where X tx is the Lorentz parameter. One could see that the standard trans- 
formation law is modified by the self-duality condition. 
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3 Abelian Chiral 2-Form: Single M5-Brane 



3.1 Anti- Symmetry 2-rank Gauge Field and BF Model 

A single M5-brane is described by the Abelian chiral 2-form theory. Let us 
first fix our notation through a short review on the anti-symmetry 2-rank 
gauge field. We consider it! 1 ' 5 as the 6D Minkowski space parametrized by x M 
with (i = 0, 1, 2, 3, 4, 5. The 2-form potential is denoted by B^ Vl as the nature 
of antisymmetry there is no diagonal components. The corresponding field 
strength is defined by 

H^x = d»B u x + d v B^ + d x B^ (22) 
which is invariant under the following gauge transformation: 

SB^ = dyAv ~ d»K (23) 

in terms of the 1-form gauge parameter A M . It seems that A Ai has six indepen- 
dent degrees of freedom, however, a crucial property of this gauge symmetry is 
its redundancy: the gauge transformation itself has an gauge transformation 
under: 

SA» = d^a (24) 

in terms of the 0-form gauge parameter a. Hence only five of six gauge pa- 
rameters are independent. The action is given by 

S = ~Jd 6 x H^H^x (25) 

with the field equation: 

d^ vX = (26) 



and the Bianchi identity is: 



e^ pa dxH lpa = (27) 
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Notice that in four dimensions a 2-form potential theory is dual to a scalar 
potential theory with only one physical degree of freedom, that is, in four 
dimensions we have 

Lad = —H^H^x = ~x \e^ vXa d^d a 4> = (28) 

where (f) represents a real scalar field. In 6D that of our interesting, 2-form 
potential theory has six physical degrees of freedom (Cf -2 = 6). 

It is also interesting to note that, although B^ v only increases one index 
compared with one- form potential A^. Many things that happen in usual 
theories in terms of do not have a straightforward generalization in terms 
of B^y. For example, in the Yang-Mills theory, terms like & vXp \A^ A v \ can 
not have its simple generalization to t llv * paT \B iiV , Bx p ], because it is zero by 
itself. Similarly, even in the abelian case, the Chern-Simon term for A^. 

L ~ e^A^Ax (29) 

gives the field equation F^ v = 0. However, a simple generalization to 2-form 
potential: 

L ~ f^B^dxBar (30) 
will give a trivial vanishing field equation, i.e. 0=0. 

A famous model in four-dimensions using two-form potentials B^ and is 
quite different from the standard action is so-called the "BF" model. Let us 
briefly review it. For an abelian action, it is simply given by 

S = j d A x e^B^Fx p (31) 

where is the Maxwell field strength. Note that the action does not involve 
a spacetime metric and one can see that the action is invariant (up to surface 
terms) under 

5A^ = <9 M A ; SB^ = d^K - (32) 
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The equation of motions obtained by varying the action with respect to B pv 
and are simply F pu = 0, = 0. The solutions of field equations are 
equivalent to = = B pv (assuming the manifold is topological trivial). 
We see that there is no local degree of freedom in the theory. 

Now we consider a generalization of the above action 

S = J d A x e^(B^F Xp - l -B, LV B Xp ) (33) 

where the second term is called the cosmological term. The action is obvious 
invariant under 5A^ = d M A, the second term, however, breaks the symmetry 
bB ilv = d M Aj, — d v K p . But one notices that this action is invariant under a 
larger gauge symmetry: 

5A fi = u p ; bB pv = d p uj v - d v u p (34) 

thus one can use this gauge to locally set A^ = 0. The equation of motions 
obtained by varying the action with respect to B pv and A p are given by 

F^ u = B yw ■ H^ x = (35) 

where the second equation is simply a consequence of the first one by recalling 
the Bianchi identity. We again see that there is also no local degree of freedom 
of the theory, i.e. A=0=B. 

Now we consider the non-abelain generalization. The action is given by 

S = Jd'x Tr e» vXp B pv F Xp (36) 

where F^ v = [D p , D v \ is the usual Yang-Mills field strength. The action is 
invariant under the following sets of gauge transformations 

<L4 M = ; SB^ = [Dp, A,] - [D v , AJ (37) 

in terms of the 1-form gauge parameter and 

5A fi = [Dp, A] ; SB^u = [B^ A] (38) 
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in terms of the 0-form gauge parameter and 

6A fl = Q; 8B IW = [F I „,M (39) 

by another 0-form gauge parameter. The equation of motions obtained by 
varying the action with respect to and are given by 

i^ = 0; e^ x [D^B ljX }=0 (40) 

which means field A is a flat connection: A can be set 0. Then the solution 
of the second equation could be written as 

= d^ v - d v ^ (41) 

for some vector <£>. Now B^ v can be set as zero by the gauge transformation 
(37). We see again that there is no local degree of freedom in the theory. In 
sum, BF theories are topological field theories and it can be generalized to 
any dimension. It is not necessarily that one always use two-form potentials 
in BF theories. BF theories have their deeper connections to knot theory, 
Chern Simons theory and gravity. It is also used to construct mass generation 
formulation for one-form gauge potential as an alternative approach of the 
Higgs mechanism. But we will not address these topics further in this thesis. 

Now we turn to our main topic of this thesis: self-dual 2-form theory. As 
mentioned, self-duality means that the original six physical degrees of freedom 
are reduced to three physical degrees of freedom if imposing the following self- 
duality condition: 

1 

note that one could consider a different sign above as the anti-self duality 
condition, however it does not matter which sign we select in the sense that 
it will also reduce half of the degrees of freedom. 



17 



As we have seen in the 2D chiral boson case, a general structure of chiral 
field formulation is the existence of an extra gauge symmetry. In the following 
subsections, we will provide 6D abelian actions in various splitting decom- 
positions that all give the self-duality condition as the consequence of field 
equations of 2-form potentials. 



3.2 5+1 Splitting Formulation 

This kind of decomposition is the simplest case where only one direction will 
be treated differently [29]. In this formulation, a two-form potential is based 
on the 5+1 decomposition of the spacetime 

R l,5 = R iA x R i 



hence the gauge potentials are decomposed into two sets: 

B^v = (B i5 , Bij) 



(43) 



(44) 



where i, j = (0, 1, 2, 3, 4) and 5-th is the special direction. One can also select 
the time direction as the special one, but our selection will be convenient when 
it comes to the dimensional reduction to D4-brane. 



Let us first denote the following notations: 



then we also have 



jjnpq 



ijk 



Tjlm5 
2 tijklm-Ll 



6 



-ijnpq 



u 



npq 



The action for the abelian chiral two-form is given by 



£5+1 — j ^ x 



1 

12 



d b x 



tt ttuvX onj"^ 
J^UvX^i — 6H ij5 



(45) 
(46) 

(47) 



(4* 
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where the second expression will be useful when considering the Lorentz- 
covariant formulation later, but in this section we can focus on the first ex- 
pression. 

We notice that the manifest Lorentz invariance only maintains in five di- 
mensions. However, just like previous 2D Chiral boson's non-covariant for- 
mulation, this 6D non-covaraint action for self-dual two-form also has a mod- 
ified Lorentz transformation law defined by (in the gauge B i5 = where 
Hij5 = d§Bij and we focus on the transformations mixed with the 5-th coor- 



SBij = (A • x)H ij5 - £ 5 (A • d)Bij 

= (A • x)d 5 B lJ - x 5 (A ■ d)Bij - (A • x)(H ij5 + \e^ nm H npq ) (49) 



one observes that the standard Lorentz transformation law is modified by the 
self-duality condition. Let us explicitly examine this symmetry. We have 



dinate): 




thus there are four terms, we write them explicitly 



(1) 




(2) 




= tot. 



(52) 
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(3) = J d 6 x[-x 5 (A ■ d)B^ klm d k H lm5 

~ J d 6 x[x 5 {A ■ d)Bijd k H ijk ] 

~ J d 6 x[x 5 (A ■ d)d k BijH ijk ] + tot. 

~ J d 6 x[x 5 (A ■ d)H ijk H ijk ] + tot. 

= tot. (53) 

(4) = J d 6 x[x 5 (A ■ d)B^ klm d k {d,B lm )] 

= J d 6 xl-^(A-d)B ij e ijklm d k B lm \^tot. 

= J d 6 x[(A ■ d)B t] H lj5 } + tot. (54) 

Thus we find that, up to total derivatives, two terms vanish and other two 
terms cancell out. The action is invariant under the modified Lorentz trans- 
formation. 



Next we turn to the question that how to obtain the self-duality condition 
from the action. We start from the equation of motion of Bjs, which is 

= (55) 

but this is just an identity if we recall eij k i m d l d k = 0. This result implies that 
components B^ only enter the action through surface terms (total derivatives). 
It means that we have an addtional gauge symmetry in the theory: 

SB i5 = ^ (56) 

for an arbitrary one-form gauge parameter $j. On the other hand, the equation 
of motion of Bij is given by 

d k H ijk = (57) 



20 



whose solution is written as 

n ijk = e ijklm d l V m (58) 

for an arbitrary one-form gauge parameter ^ TO . Now we see that under the 
gauge transformation (56) one can absorb ^ by using the gauge parameter 
<£>j to obtian the self-duality condition of 2-form potentials: 

H ijk = (59) 

this result also implies Hijs = 0. This is the only self-duality condition that 
we need in the 5+1 splitting non-covaraint formulation. 

We notice that we have picked 5-th as our special direction and we used 
the gauge = above. Thus if we integrate the 5-th direction on both side 
of the self-duality condition, we will get: 

J dx 5 (~e ijklm H klm ) = B.^X 5 = 2ttR) - B l;] {x b = 0) (60) 

as an interesting consistency condition for the self-dual theory. 

3.3 3+3 Splitting Formulation 

Another formulation of chiral 2-form is based on the 3+3 decomposition of 
spacetime [12]: 

#i,5 = R i,2 x #3 ( 61 ) 

Originally it was invented by studying Bagger-Lambert-Gustavsson (BLG) 
multiple M2-branes model by promoting Lie 3-algebra into the infinite-dimensional 
symmetry of volume preserving diffeomorphisms of an internal 3-dimensional 
space. Physically this 3+3 splitting means that the 3-dimensional worldvol- 
ume of M2-branes combines with extra 3-dimensional internal space to form a 
6-dimensional worldvolume of a single M5-brane that carries the chiral 2-form. 
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The 6D Lorentz symmetry SO(l, 5) is broken to 50(1, 2) x 50(3) and the 
gauge potentials are decomposed into three types: 

B, v = (B ah B ah , B. b ) (62) 

where a = (0, 1, 2) and a = (3, 4, 5). Notice that in this way B ab or B- b has 
three components while B ab has nine components. 

The action is given by 

^3+3 = -^J d Q x[H abc {H abc -H abc ) + ?>H a ^ 

= ~J d 6 x[H ahc n ab ^3H abd H ab '] (63) 

one can check that components B ab enter the action only through total deriva- 
tives. Its field equation is trivial (vanishes identically) and is given by 

(d c H abc + 3d c H abd ) = (64) 

that means there is an additional gauge symmetry in the theory: 

SB ab = $ ab (65) 

for some arbitrary 2-form gauge parameter <fr ab . 

Notice that in this 3+3 formulation, we will need to show both equations 
at the same time 

H ak = (66) 
U hbt = (67) 

to justify this is the right action describing chiral 2-form. However, we only 
have a special gauge transformation coming from B ab (65), is it possible to 
achieve both equations under a single gauge transformation? We will see in 
the following that the answer is positive. 
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The equations of motions derived from varying the action with respect to 
components B ; and B^ b are given by 

d d Kk = (68) 
d c H hbc + d t H hht = (69) 

the first equation implies the solution 

n aht = \e hht e ahc 3^ bc (70) 

for some arbitrary tensor <& bc . Thus we find that after making the gauge trans- 
formation: 5B ab = $ a 5, one part of self-duality conditions could be obtained: 

= o (71) 

Using this result, we could further rewrite another field equation as a total 
derivative: 

1 

— • 

2 

then we can solve it by considering 

1 
—i 

2 

for some function ^(x a ) independent of coordinates Xa- The trick is that we 
could still redefine 



d\H hht + -e, k e abc d a B bc ) = (72) 



Hak + ^abcZa b cd a B bc = e. k *( Xa ) (73) 



B ab -> B ab + ^e abc <S> c (x a ) (74) 

where § c (x a ) is selected as d c § c (x a ) = ^(x a ). It is important to notice that 
since <f> c (x a ) is independent of coordinates a;^, this further redefinition/transformation 
of B ab does not spoil another self-duality condition. Thus we arrive the re- 
maining self-duality condition 

= (75) 

Finally, let us conclude this section by mentioning modified Lorentz trans- 
formation laws in this 3+3 formulation. The action is manifestly invariant 
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under the 50(1, 2) x 50(3) subgroup of the full 50(1, 5) Lorentz group. The 
Lorentz symmetries mixing x a and x a are no longer manifest. The claim is 
that the action is still invariant under the following modified Lorentz trans- 
formation laws that are parametrized by 3 x 3 constant matrix X aa : 

SB aa = \* B hh + \ b d (x b d d - x%)B aa + \ix d H cai (76) 
5B hb = \ h a B a "-\iB ah + \ b d (x b d 6 -x 6 d b )B hh (77) 

where we have considered the gauge B ab = for the simplicity. One could see 
that these modified transformation laws become the standard Lorentz trans- 
formation on the mass shell. 



3.4 4+2 Splitting Formulation 

We have constructed chiral 2-form theories based on 5 + 1 splitting and 3 + 3 
splitting. It is nature to ask for a formulation based on 4+2 splitting, which 
is given in [8]. Here the six dimensional Lorentz symmetry 50(1, 5) is broken 
to 50(1, 1) x 50(4). In this formulation, the chiral 2-form is based on the 
4+2 decomposition of spacetime: 

R l,5 = R l,3 x R 2 ( 7g ) 

and the gauge potentials are decomposed into: 

B, v = {B ah B ab , BJ (79) 
where a = (0, 1) and a = (2, 3, 4, 5). The action is given by 

5 2+4 = -i J d 6 x (2H abd H abd + H ak U ak ) . (80) 
The field equation of B ab is again trivial (vanishes identically), and is give by 

d°H ab a = 0, (81) 

that implies the gauge transformation 

SB ab = <5> ab . (82) 
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The field equations of B a ^ and B b are 



d'Kah = ^ (83) 
9 d (n + H) abc + d a H aib = 0. (84) 

The solution to the first equation (83) could be written as 

Kah = e ab e hbdd d^ bd (85) 

for some arbitrary functions ty bd . By taking the Hodge-dual of both sides, we 
get 

Kai> = 9^ ah ~ d b * ail . (86) 

Identifying these two results, we have 

da** ~ d b * a , = e ab e hbM d^ b i (87) 
Now we act d b on both sides of the equivalence relation to get 

d b d b V a a ~ d h dh ah = 0. (88) 

Because of the solution (85) is unchanged under the transformation 

^aa ^aa + & A a . (89) 

we choose the Lorentz gauge to fix that redundant symmetry, i.e. d a ^ a a = 0. 
Now (88) reduces to 

dH ah = 0, (d 2 = d%). (90) 

Next we consider a proper boundary condition that ^ aa vanishes at infinities 
of the 4D Euclidean space with coordinates Xa such that it has the unique 
solution = 0, thus we obtain one of the self-duality conditions 

Kah = 0- (91) 
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^abc = ^akddU ab (92) 



If we plug this result into the equation of motion of B.; (84), we find we get 
the solution 

1 

2 

for some arbitrary functions (j) ab . Now we use the gauge transformation SB at, = 
$ a 6, this equation becomes 

^ahc = 0- (93) 

so that we obtain self-duality conditions for all components of the field strengths 
in this 4+2 formulation. 

Let me summarize this section by providing the modified Lorentz transfor- 
mation laws of this 4+2 formulation. The action is manifestly invariant under 
the 50(1, 1) x 50(4) subgroup of the full 50(1, 5) Lorentz group, while the 
Lorentz symmetries mixing x a and x^ are not manifest. The modified Lorentz 
transformation laws that are parametrized by 2 x 4 constant matrix A a( j are 
given by 

SB aa = \*B hd + \ b -(x b d d -x d d b )B ah + \{x-H cak (94) 
5B hb = XlB ba - X h b B hb + \\{x h d 6 - x%)B hb (95) 

where we again consider the gauge B a b = for the simplicity. One could see 
that the modified transformation laws become the standard Lorentz transfor- 
mation on the mass shell. 
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4 Covariant Formulations: PST Model 

We have constructed various non-manifest Lorentz invariant actions for self- 
dual fields. However, it is always desirable to find covariant formulations espe- 
cially when one wants to consider more complicated cases when fields couple 
to gravity and invastigate the potential gravitational anomaly among chiral 
fields for instance. 

It turns out that we need to introduce auxiliary fields to construct covari- 
ant self-dual field theories. In fact, people have considered different number 
of auxiliary fields that vary from infinity to only one auxiliary field. In this 
thesis, we will only consider the most modern approach, that is so-called PST 
formulation [10]. 

The general lesson we will learn is that there will be an extra gauge sym- 
metry that allows us to gauge fix the auxiliary field to the proper configu- 
ration and PST covariant formulations of self-dual fields reduce to previous 
non-covariant self-dual actions that we have discussed in previous sections. 
We will start from a covariant formulaiton of two-dimensional chiral boson 
and then we consider covariant formulation of the six-dimensional self-dual 
two-form theory for a single M5-brane. 

4.1 Covariant action for Chiral Boson: D=2 

The PST covariant action for a two-dimensional chiral boson was constructed 
by using a single auxiliary scalar field , let us call it "a(x)". Notice that 
this auxiliary field should be spacetime dependent for the sake of the Lorentz 
symmetry. The action is given by [10] 




(96) 
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where a, 6 = 0,1. And here we will not need to distinguish time or space 
coordinate explicitly here. We define F a = d a (f) as the field strength of the 
boson (j)(x) as before and T a is defined by 

J r a = F a - e ab F b (97) 

as the expression for the self-duality condition. 

The action has the following two sets of gauge transformation 

(1) 50 = /(a), 5a = (98) 

(2) 50 = j^d b aT b , 5a = tf)(x) (99) 

with gauge parameters f(a) and ip{x). The second gauge symmetry plays a 
important role which allows us to guage fix auxiliary field to, for example, fix 
a = x. This gauge-fixing choice will reduce this PST covariant action to the 
previous non-covaraint FJ action (13). 

Now let us see how to obtain the self-duality condition from this covariant 
action. The equation of motion of 4>(x) is 

^ ab db[w7^d a ad c aT c ] = (100) 

which implies the following solution 

:d n ad r aT c = &Q (101) 



{da) 2 

for some arbitrary scalar Q. Then let us project this solution with two orthog- 
onal vectors: d a a and e ab dba, to get two equations 

\d c aT c = d a ad a n (102) 
e ab d a ad b tt = (103) 

we see the solution to the second equation (103) can be given by 

Q = f(a) (104) 
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for some arbitrary function of a{x). Plug it into the first equation (102) we 
obtain 



On the other hand, we observe that under the gauge transformation 5(f) = 
f(a), 5a = 0, the left hand side of the equation (102) becomes 



which implies the self-duality condition. Notice that this implies T = if 
one fixes a{x) to x\ for example, it gives OqcJ) — d\(f) = 0, which is just all we 
need for a chiral boson. Fixing a(x) to x° will give the same result. Notice 
that the equation of motion of a is trivial in the sense that it is proportional 
to the self-duality condition, as we have used the self-duality constraint, the 
equation of motion of a(x) will not give an extra constraint on fields. 

We also notice that the action (96) has the same form as Seigel's action (9), 
but the key difference is that the self-duality conditon obtained from Seigel's 
action is through the field equation of auxiliary field A. While in the PST 
formulation, the self-duality condition is obtained from the field equation of 
(j) with an additional gauge transformation. However, these two theories are 
the same in classical level in the sense that they have the same equation of 
motion (the self-duality condition). 

4.2 Covariant action for Chiral 2-form: D=6 

The Lorentz-covariant action for the Abelian chiral 2-form theory (or the gauge 
sector for a single M5-brane) is constructed also with the help of a single aux- 
iliary scalar field. We will see again that this PST covariant model has an 




(105) 
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extra gauge symmetry which could be used to gauge fix the auxiliary field and 
reduces to the previous non-covariant PS action (48). 



The covaraint action is given by [10]: 

s = ^Jd 6 x (- ^h^h^x + \^ vp p;n^ a ) (108) 

where 

U^a = (H- H)^a (109) 

with H represents the Hodge dual of H: 

H^ x = — e ^bc Habc / U0 N 
6 

and we denote 

d^bd b 
o oo v o 

(db) 2 K ' 

in terms of an auxiliary field b(x). 

Since the algebra in six-dimensions will be more complicated than previous 
two-dimensional case, let us derive equation of motions explicitly here and in 
the end we will observe the crucial existence of an extra gauge symmetry. 

The equation of motion of B a p from the first term gives: 

— J - = d 7 H a ^ = 



2 

where we have considered the identity : 



= o> 7 (^e a/37 ^ A P;^ A + 3p[ a ^ 7 ^) (112) 



.aPj^isX pan/ ^ a(3jiJ,pX ponjnr\8 ^|^ r[ a ^7A t ] pcrgjKrjS 

r V n-ovX — twXKrjS-Ln rL — u [ aKT] S] r /z n 

-1 

= -( - 2\3\P^n a(31 + 2! (4! - 3!)P^ /37] ^) 

= -2U ah + Z\P [ *U h]ls (113) 
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while the variation of the second term gives: 



^ = -d^P^U^ + ]-e a ^ vX P^U av i^U) 



5B a/3 5B a p 'V M 2 

Overall we have the variation on the action with respect to B pv \ 



115) 



where 



3 b 

~ {dbf 



(116) 



Next we consider the equation of motion of b(x), which only appears in the 
second term of the action, we have 



5[\w v pp (j p n [lva 

5b 



-a" 



B b 

H (dbf ^ 



+ <9 7 



8 b 

njpvp per _^_r_nj 

9 (56) 2 ^° '. 
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Then we notice that the first term can be written as (by (113)): 

= -d^H a ^e a ^ vX H vX d,b + HapFpi^) (111 



where we have used the fact that 



d x bd v b 
Hp V d b = = 



(119) 



Overall we have the variation of the action with respect to b(x): 

^(H a pe a ^ vX H uX d^8b = H^^id.H^b 5b (120) 
In sum, the variation of the "Abelian" PST action gives: 
5S= [d 6 x(- e a ^%b(d p H„ x )(5B aP ) + e a ^ x d,b{d p H vX )H aP {5b)^2l) 
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so it is obvious we have an extra symmetry under the gauge parameter 0: 

SB,,,, = H^cf) (122) 
5b = (123) 

which allows us to fix b(x) to x 5 to get the non-covariant action (48). Notice 
that one should avoid setting 6 = since it brings the singularity into the 
theory as field b appears in the denominator. 

The next question is how to obtain the self-duality condition from this 
covariant action. We first find the general solution of the equation of motion 
of B^y (one can read it from the first term in (121)) could be given by letting 

U, vX d x b = (db)%$ v] + d^bd v] <$> p d?b + d%d p %d u] b (124) 

for some arbitrary vector Q^. Just like we have studied in previous D=2 case, 
we should be able to find a way to "absord" the right hand side of the above 
equation in order to obtain the self-duality condition. Indeed, there is an 
additional gauge symmetry of the action, and the transformation is give in 
terms of the gauge parameter $^ 

5B, V = (0 M 6)$„ - ($,6)$,, (125) 
£6 = (126) 

this symmetry will generate the same form as the right hand side in (124) 
when considering 5{Ti^ v \d' K b) 1 so that we obtain the self-duality condition for 
the 2-form potential. On the other hand, one can check that the equation 
of motion for the auxiliary field b is trivial because it is proportional to the 
self-duality condition. Also notice that if we fix the auxiliary field by a = x 5 , 
the extra gauge symmetry of B (125) reduces to 5B i5 = $j 5 , which is just 
the extra gauge symmetry used to obtain the self-duality condition in the 
non-covaraint PS action. 
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5 Non-Abelain Chiral 2-form: Multiple M5-Branes 



Multiple M5-branes system has been the most challenging and mysterious 
brane system in string/M theory. A single M5-brane is described by Abelian 
self-dual 2-form gauge field theory that we have discussed in previous sections, 
when branes start to close to each other, interaction among M5-branes will 
appear and we expect multiple M5-branes system should be described by a 
certaion "non- Abelian" self-dual 2-form gauge field theory. As we have seen in 
previous sections, to construct an action for self-dual fields is already a highly 
non-trivial task, here we will face a bigger challenging which is to formulate a 
non-Abelian 2-form theory. 

Notice that formulating a non-Abelian 2-form gauge theory should be to- 
tally independent from formulating a self-dual field theory. Only having non- 
Abelian 2-form gauge theory is not sufficient to describe M5-branes, we will 
need to combine these two characteristics in the end. 

5.1 Non-locality: The hint from No- Go theorems 

Several famous no-go theorems [21] claim that such exotic system (multiple 
M5-branes) is impossible to build. They considered general deformations of N 
commuting copies of Abelian self-dual 2-form gauge theory in 6 dimensions, 
and they found that a consistent non-Abelian deformation is always trivial in 
the sense that it will be equivalent to simply a change of variables that does 
not really deform the gauge algebra. However, every no-go theorem has their 
weakness, although they did not assume the deformed gauge transformations 
to correspond to a particular type of symmetry algebra, they did assume that 
the deformation was local. 

However, only introducing non-locality is not enough to see where we should 
go and of course we will need other ideas. We will discuss them in detail in 



33 



this chapter. We will construct a non-Abelian self-dual 2-form gauge theory in 
6 dimensions with a spatial direction compactified on a circle of radius R (The 
reason for the compactification will be given later). It has the following two 
important properties to be justified as a correct theory for M5-branes. (1) it re- 
duces to the Yang-Mills theory (multiple D4-branes) in 5 dimensions for small 
radius R. (2) It is equivalent to the Lorentz-invariant theory of Abelian chiral 
2-forms when we turn off the coupling. Previous no-go theorems prohibiting 
non-Abelian deformations are circumvented by introducing nonlocality along 
the compactified dimensional] 

5.2 The Main Ideas 

The main ideas of this formulation are two-fold. First, although there is no 
rule telling us that we must introduce covariant derivatives in this kind of 
non-abelian higher form gauge theory. However, it is unclear how to construct 
a non-Abelian theory that has the covaraint structure without introducing 
covaraint derivatives. Also notice that if we have a non-Abelian 2-form theory, 
we expect that, after compactification it should reduce to the non-Abelian 1- 
form theory, which is just the standard Yang-Mills theory, where we use the 
covariant derivatives and the gauge transformation is the standard one 

5A^=[D^\] (127) 

in terms of the 0-form gauge parameter A. Thus we might want to define 
covaraint derivatives, but there should be a 1-form potential together with 
ordinary derivatives to define covaraint derivatives. So the first question is: 
what is the 1-form in the theory of M5-branes? 

Naively, one might try to introduce a one-form potential A^. However, in 
the theory of M5-brane(s), there is no such field. Furthermore, introducing 
extra field potentially implies more physical degrees of freedom, which we 
certainly do not want. One may try to consider this as an auxiliary field, for 
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example, it could be gauged away by an extra gauge symmetry. But if it is the 
case, the theory is the same as a theory without ^4 M , then there is no covariant 
derivatives. On the other hand, Chern-Simon actions are only defined in odd 
dimensions, it may be possible to find another kind of topological theory of 
one-form potential in six dimensions to construct the theory, but it is not clear 
how to do it. Instead, in this formulation, we define the covaraint derivatives 
in terms of the zero modes of 

Di = di + gB$ (128) 

Note that the zero modes of B^ is just the Yang-Mills one-form vector poten- 
tial, thus covariant derivatives we use is the same in the standard Yang-Mills 
theory. 

We will consider the case where the worldvolume of M5-branes is on a circle 

R 1A x S 1 (129) 
where S 1 is a circle with the radius R 5 with a periodic coordinate 

x 5 ~ x 5 + 2ttR (130) 
For an arbitrary field we have the decomposition 

$(^) = $ (0) W+XiWe i51 ' 

(n) 

$(°) + (131) 

where we use the notation that the superscript "(0)" represents zero modes 
while "(KK)" represents Kaluza-Klein modes. Obviously, we have 

<9 5 $ (0) = 

= d^ {KK) (132) 

5 Here we consider a space- like circle for the sake of reducing to D4-branes theory in i? 1,4 . 
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The second key idea in this model is that we will introduce the non-locality 
in the theory through defining a non-local operator 

d, 1 (133) 

this operator consistently acts on KK modes in the sense that when d§ acts on 
KK modes, it gives ~ ^ with nonzero n, so that it could be invertible. And 
it satisfies 

d^ds® = <5> {KK) (134) 

The non-locality that we introduce could be considered as the way to cir- 
cumvent previous no-go theorems claiming that it is impossible to construct 
a theory of M5-branes, as those theorems are all based on the assumption of 
the locality in the theory. We will see this non-local operator indeed plays an 
important role in this formulation. 

5.3 Non-Abelian Gauge Transformations for 2-form Potentials 

We define the non-Abelian generalization of gauge transformation laws of the 
anti-symmetry tensor field (2-form) Bij as [1] 

SB* = [A.Asl-^+^^Af] (135) 
5Bij = [A, A,] - [D d , A,] + g[B ih kf] - g[F ih d^hf K) ] (136) 

where parameter g is the coupling constant with the mass dimension. 6 and 
i,j = 0,1,2,3,4. The covaraint derivative is in terms of zero modes A = 
di + gBj® and the 2-form field strength F is defined via the standard way 

F V = g- 1 [Di, Dj[ = a,B]°> - a,flg» + g[B? 5 \ B«°»] (137) 

which is just the same in the Yang-Mills theory. Notice that Fij in fact is zero 
modes, that means d$Fij = 0. 

6 Note that in the M-theory, there is no adjustable parameter, we will see later that the coupling constant 
g turns out to be the radius R of the M-circle. 
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More explicitly, we can decompose the gauge transformation laws into 
SB® = [A,Al 0) ] (138) 



5Bl« K) = [A.Af^-^A^ + ^Un (139) 
SB® = [A.Af'j-^.Afj + S^'Af] (140) 

6b^ = [a, A<™ >] - [D jt A r »] + fl $r\ a<° >] - a-Ar »] 



with all quantities B^, 5^, A5, Aj take values in a Lie algebra G. 



The algebra of gauge transformation is closed and given by 

[6,61 = 6" (142) 

with 

Af» = fflAf.Af] (143) 
A!' = fflAf.A'J-sIAf ,Ai] (145) 



Let us give some comments on these non-Abelian gauge transformation 
laws. 

First we notice that there is a non-local term in 5B\^ K ^ (141). Why we need 
that? Recall that, consider the case in six dimensional spacetime, there should 
be only 5 independent gauge parameters for the 2-form potential gauge theory 
rather than 6 since there is a redundant symmetry for the gauge parameters. 
In non-Abelian case, it is defined by 7 

6Af K) = [Di,\W] (146) 
6Af K) = d b \^ (147) 

7 Alt hough there is no rule foucing us that we must define it in this way, however we should define it in 
a nature way that reduces to the abelian case when the coupling is tured off. 
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one can check that (141) is indeed invaraint under these redundant transfor- 
mations. The existence of the "gauge symmetry of gauge symemtry" is crucial 
for this non-Abelian gauge transformation laws to be justified as the correct 
deformation of the Abelian gauge transformation laws of 2-form potentials. 

Now we can use the redundant symmetry to fix 

kf K) = (148) 

by using the freedom of A^^, then the guage transformation laws are equiv- 
alent to 

6Bg"> = -a 5 A«™» +fl [4 A ' K, ,Af] (149) 
6Bf K = [A.Af^l-PA^l+sIBrUr] (150) 

where 

A< A ' A ' ) = AP' ) -[A,a 5 - 1 Af A ' ) ] (151) 
Notice that the zero modes A^ can not be gauged away since 

We notice that in non-Abelianizing the gauge transformations of a 2-form 
potential, the zero mode A5 plays a special role. We associate the special 
role played by Ag to its topological nature: while A5 can be gauged away 
the zero mode A^ corresponds to the Wilson line degrees of freedom for the 
gauge transformation parameter A along the circle in the x 5 direction. 



One might ask how about the gauge parameter A^ and its redundent 
symemtry? The fact is that we will not use and hence neither A z - ^ in 
this formulation, we will soon see the reason of it, let us discuss this point 
later. Also notice that the only non-local term in the gauge transformation 



8 If the zero mode A^ ^ can be gauged away, then there is no gauge parameter for the Yang-Mills theory 
of D4-branes 
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laws is gauged way through the change of variables, but it does not mean that 
this theory is local since the non-locality is hidden in the gauge parameters 
we redefined. 



On the other hand, we have "additional non-locality" introduced in the 
theory in the sense that the gauge transformation laws are defined separately 
for the zero modes and KK modes: For instance, one may think the term 
SBfo' could be deduced form 8B^ K \ but we see there are in fact different 
by a factor 2 through the commutator term. Also notice that we did not 
introduce terms like 

[srur'i (152) 

in particular, thoughout this formulation we find that all the commutators 
should involve at most one KK mode. Future works about the geometric in- 
terpretation of this formulamation might help us to better understand these 
interesting consequences. 



Finally, we could easily observe that if G is abelian, this non-Abelian guage 
transformation laws are reduced to the conventional Abelian gauge transfor- 
mation of 2-form gauge potential, which is used to describe a single M5-brane. 



5.4 Non-Abelian 3-form Field strengths 

We define 3-form field strengths as 

4s = F.^g-^D,] (153) 
= [A, BjT>] - [Dj, B<™>] + ftfl<r> (154) 
H\% = [A.B^l + l^Bfl + lA^] (155) 

+<?[% ^f ] + g[F jk , d^B^ K) ] + g[F M , c^sjf %6) 
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They satisfy the generalized Jacobi identities 

£[A,#jS] = (157) 

(3) 

£Mr] = d,Hg K) (158) 

(3) 

£[a,j$1] = Ei% B «] ( 159 ) 

(4) (6) 
(4) (6) 

where represents a sum over n terms that totally anti-symmetrized all 
the indices. 

These 3-form field strengths transform as 

SH$ = 9 [^,Af] (161) 

M% K) = 9 [CAf»] (162) 
5H\% = g[H$l A< 0) ] + g[F v , A<°>] + g[F jk , A< 0) ] + ff [F«, A< 0) ] (163) 

«C = ff[< J °.Af ) ] (164) 
a potential problem here is that the transformation of is not covaraint 
9 , that causes a trouble to construct an gauge invar aint action. We will deal 
with this problem later. 

Let us consider a useful gauge 

B<f K) = (165) 

by using the freedom from the gauge paramter . We use as our 

variable to denote the theory under this gauge, we have 

<*> = ^r> dee) 

HT = [D.B^ + lD.B^ + lD.Bin (167) 



9 Unless Fij = by itself, however, it will imply the zero modes, , is a pure gauge and the theory is 
the same as no connection. 
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where we can also wite 



Bij = d, l H^ K) (168; 



(o) 



which transforms covaraintly 6 = [B^ , A 



5.5 Coupling to Antisymmetry Tensors 

Apart from multiple M5-branes, let us also consider applications to this formu- 
laiton. Readers who want to focus on the thoery of M5-branes might simply 
skip this section for the first reading. 

A straightforward generalization of the transformation laws for H leads to 
the definition of gauge transformations of a totally antisymmetrized tensor 
field {n < 6). We define their gauge transformation laws as 

<5<..,„_ l5 = fl[<^5.Af], (169) 
S€Z* = 9\€ K L^fl (170) 
<C,„ = S [CvAf]+ 9 E[e„- lS ,A«] (171) 

(n) 

{KK) _ tAKK) .(KK) 



IVlr, 



where Y2( n ) represents a sum of n terms that totally antisymmetrizes all in- 
dices. 



We see that the gauge transformation law for the component is differ- 

ent from all other components. It is defined to mimic the gauge transformation 
of H^. We should check whether this complication will prevent us from con- 
structing a gauge field theory. First, products of these fields (f^...^ will also 
transform in the form of not being covariant (where we consider that all indices 
are antisymmetrized on the products). Secondly, although Di acts on <^... ? - 
does not transform covariantly, we can define a covariant exterior derivative 
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for dJP ■ as 

W)f ) .. i ,^Ei D -€. i ,J-(- 1 )" E pM^-wJ- (173) 

(n+l) ((n+l)n/2) 

(This expression is nontrivial only if n < 5.) This covariant exterior derivative 
is indeed covariant, that is, 

WSv, = gimt^AP] + 2 £ i W)S^5, a£> J, (174) 

(n+l) 

where the exterior derivative of </>i r -in-i5 * s defined by 

w)i ^ = sE[^^- ( 175 ) 

(n) 

It seems possible to down covariant equations of motion using exterior deriva- 
tives and totally antisymmetrized tensors. 



5.6 Non-Abelianizing the Abelian Self-Dual Theory 

We have mentioned that the anomalous transformation of H^l (163) will cause 
the problem to define a gauge invariant action. For example, if we define a 
Yang-Mills-like theory, the Lagrangian should look like 

-Tv(H^ k H^ k + 3#$#<°>« 5 + H \f k K) H^ KK ^ k + 2>Hg K) H^ KK ^). (176) 

Only the first term is not gauge invariant. It is not clear how to modify the 
action to make it invariant. Similarly it is hard to define the usual kinetic 
term for the components 0^...^ of a matter field. In the following we will see 
that in a Lagrangian formulation of the non-Abelian self-dual gauge theory 
in 6 dimensions, we do not have to use the variables explicitly, so these 
anomalous covariant transformation laws will never be used. In fact we will 
simply define H^ k to be the Hodge dual of Fij 

H\% = \e ijklm F lm (177) 
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so that its gauge transformation is the same as other components. As a result 
the covariant transformation laws for matter fields can be uniformly defined 

as 

5<5> = g[<5>,Af ) } (178) 
for all components of a matter field. 

Recall that the Abelian action for chiral 2-form is (48) (we can obtain it 
from a gauge-fixed PST action (108) as mentioned before) 

1 



S = \t M5 T m 2 2 j d 6 x r-e^ klm H ljk 



(179) 



consider the compactification of the Abelian theory on a circle of radius R 
along x 5 . All fields then are decomposed into their zero modes and KK modes, 
the action becomes 

S = s^ + S {KK \ (180) 

where 

S <0) = 2j §T M ,Tu\ J 'fix B^HW" (181) 



(182) 



Where the zero modes are 5 dimensional 2-form potential, one can carry 
out the standard procedure of electric-magnetic duality for to get an 
action for the dual 1-form potential 

S ( Z = ^T M sTi£ I fix (183) 



where Fij = H\®\ is the field strength of the dual 1-form potential B^\ 

Let us check that how equations of motion derived from the action SfJ al + 
g(KK) } eac [ s ^ configurations satisfying self-duality conditions. For the zero 

43 



modes, the equation of motion derived from the action S^J al is 

d j F i:j = 0. (184) 

Defining a 3-form field H by 

H^l = ±e ijklm F lm : (185) 

we see that, due to the equation of motion d^F^ = , a 2-form potential 
exists locally such that = dB^\ Since F also satisfies the Jacobi identity 
dF = 0, we also have 

d k H^ = 0. (186) 

Note that our definitioan of H^l is identical to the self-duality condition for 
the zero modes 

H$l = \e mm H^ (187) 

hence we see that the zero modes of the self-dual gauge field can be simply 
described by the 5D Maxwell action. 

It is natural to non-Abelianize the equation of motion for the zero modes 

by 

[D^Fij] =() + ■■■ (188) 

up to additional covariant terms that vanish when the Lie algebra G is Abelian. 
In the next section we will derive the complete equation from an action prin- 
ciple. Let us stress again that for the non- Abelian theory, we still define 



simply as the Hodge dual of F$j, hence it is not necessary to introduce the 
new definition of H^l which has the unusual transformation law. The trans- 
formation of Fij would then imply that H^°\ transforms simply as 

^ = [flg2,Af]. (189) 

On the other hand, for the KK modes, the equations of motion derived 
from varying S^ KK ^ is 

e ijklm dk ^ H (KK) + ^ eimnpqH (KK)n Pq ^ = q ^ 
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This implies that 



Ajklm 



'h\™ ] + \e, mnm H^>A = e ^».$<™> (19i; 



(KK) 

for some tensor §\ m satisfying 

e i jk im dk Q(KK) = Q ^ 

We can redefine by a shift 

C'-e^C+^'C (193) 

such that, 

Hg? -> ffiS" - + (194) 

Imnpq tt(KK) . Imnpq tt'(KK) Imnpq tt(KK) flQ^ 

t n npq ~ f t n npq ~ fc n npq \ 1JO ) 

As a result of this shift (This shift is also a gauge symmetry of this theory), 
we have the self-duality condition 

H\1P = -\e, m n„H^ KK ^. (196) 



Let us define the non-Abelian counterpart of the equation of motion of KK 
modes as 



^ijklm 



0. (197) 



This implies that 

e ijklm ( H {KK) + l _ eimnpqH {KK)npq\ = ^jklm^KK) ? (igg) 

where satisfies 

jW m [D k ,$\* K) ] = 0. (199) 
This again can be absorbed into a shift of B^ K ^ 

B^ K) -> B}« K) - C + 9^Z K \ (200) 
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so that the self-duality condition is arrived. Notice that it is the KK modes 
that allows us to consider this "non-local" shift as this non-local operator 
only consistenly acts on KK modes. Also note that the gauge transformation 

(KK) 

parameter has to transform covariantly 

< A 'MC K) .A< 0) ], (201) 

because the constraint of it is covariant. It can then be checked that this extra 
shift commutes with the gauge transformation defined previous Section. 

Our task in the next section is to give an action that would lead to the non- 
Abelian equations of motion (188), (197) , which we have shown here that it 
will give the self-duality condition of 2-form potentials. 



5.7 Action 

Let us consider the following action for the non-Abelian chiral 2-form potential 
(the gauge sector of multiple M5-branes) 

S = S {0) +S iKK \ (202) 



where 




S (0) = 


rrt rrt — / 

±MbJ-M2 


q(KK) 


-T M5 T M \ J 



(203) 



(204) 

this invariant action is a straightforward generalization of the action for the 
Abelian theory. For small R 7 the M5-branes should be approximated by D4- 
branes in the type HA string theory so should be identified as the Yang- 
Mills theory for multiple D4-branes 

S<® = \T m T- 2 J d 5 x Tr(/ y n, (205) 
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where the field strength for multiple D4-branes is 

ft, [di + Ai, dj + Aj] = diAj - djAi + [Ai, Aj]. (206) 

It is known that the gauge potential A in D4-brane theory is related to the 
gauge potential B in M5-brane theory via the relation 

Ai = 2ttRB^. (207) 

Plugging in the values of the parameters involved, 

T m = ^li a , T ™ = J^jS< T * = 2^I> R = 9lt " (2 ° 8) 
we find that the coupling constant should be given by 

g = 2ttR. (209) 

This factor can also be obtained by demanding that the soliton solutions which 
resemble instantons in the spatial 4 dimensions have momentum equal to n/R 
for some integer n in the x 5 direction. 

Notice that the overall factor of 2tiR due to the integration over x 5 will be 
multiplied by a factor of 1/g 2 where g is the Yang-Mills coupling for the zero 
mode field strength F$j, giving an overall factor of 1/R, in agreement with 
the requirement of conformal symmetry in 6 dimensions [22]. Normally the 
coupling constant of an interacting field theory is independent of whether the 
space is compactified. Our strategy is to define a 6 dimensional field theory 
as the decompactification limit of a compactified theory and the coupling de- 
pends on the compactification radius. In some sense, the coupling constant g 
is not really the coupling of the decompactified theory, which is a conformal 
field theory without any free parameter. 

Assuming that we will be able to show in future works that a well defined 
theory does exist in uncompactified 6 dimensional spacetime as the decom- 
pactification limit of our model, one would still wonder how such a theory can 
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be fully Lorentz invariant, while its definition involves the choice of a special 
direction. We will discuss more on this point later. 



The variation of S^ ' leads to Yang-Mills equations, which can be inter- 
preted as the self-dual equation for the zero modes. The full equation of 
motion for the zero modes B^ should also include variations of S^ KK \ which 
modifies the Yang-Mills equation by commutators that vanish in the Abelian 
case. Explicitly, the equations of motion is 



r2irR 




/ dx 5 




Jo 



_^ijklm 



(KK)\ 



m5 



(210) 



A useful feature of S^ KK ^ is that it depends on B\§ K ' and B 



only 

through B^ K \ Therefore, we only need to consider the variation of b\ K 



{KK) 
ij 



Explicitly, the equations of motion is 

ijklm 



Dkj f H im5 ^ + ^€i mnpq H <y ^ pq 







(211) 



which leads to the equation of motion that is equivalent to the self-duality 
condition via a shift in B^ K ^ as we explained in the previous section. 



Notice that despite the appearance of the nonlocal operator d^ 1 and the 
nonlocal separation of KK modes from zero modes in the 5-th direction, this 
action is an ordinary local action from the viewpoint of the uncompactified 5 
dimensional Minkowski space. 

2ttR, 



S = 



Ti rp — 2 



•{■ 



.ijklm 



hijk(-p) 



bim(p) + ^e lmnpq h npq (p) 



}, (212) 



where biAp) and hijk(p) are the KK mode coefficients of B^ and H^k defined 
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by 

Byfax 5 ) = Y,kMPy PX5/R , (213) 

pez 

H ijk (x, x 5 ) = d *hk{x,p) + ?)> hk&p- q)} e ipx5/R 

{i,j,k)pez \ qez J 

(214) 

where ). The derivation of the equations of motion above 

can be viewed as a collective expression of equations of motion derived by 
varying each KK mode or zero mode one at a time. 

It is clear from these expressions that our theory is local in the directions of 
x, and its nonlocality is restricted to the ^-direction. At this moment we can 
not prove or disprove the causality in the direction of x 5 . At least causality is 
apparently still preserved in the uncompactified directions x. 

5.8 Comments 

In this formulation, we have avoided commutators involving two KK modes, 
e.g. terms of the form [B^ KK \ A> KK >]. Correspondingly, there is no term of 
the form \B^ KK \B^ KK '] in the equations of motion or action. In fact, all 
gauge interactions are mediated via zero modes. Here is our interpretation. 
In the limit R — > oo, the Fourier expansion of a field approaches to the Fourier 
transform 

$(x 5 ) = y <f> n e inx 5 / R — ► $(x 5 ) = f — $(k 5 y hx5 . (215) 

The coefficients $ n approach to $(^5) as 

$(k 5 ) = 2irR$ n (fa = n/R). (216) 

According to this expression, the value of a specific Fourier mode $ n must 
approach to zero in the limit R — > 00. In particular, the amplitude of the zero 
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mode approaches to zero. While all interactions are mediated via the zero 
mode, this does not imply that there is no interaction in the infinite R limit, 
because the coupling g = 2ttR —>■ oo. The product of the amplitude of the 
zero mode with the coupling is actually kept finite in the limit. 

(KK) 

In the limit R — > oo, the KK modes B)w should be identified with the 
2-form potential in uncompactified 6 dimensional spacetime. In uncompacti- 
fied space, the constant part of B^ v is not an observable, hence physically the 

(KK) 

KK modes B^u do not miss any physical information a 2-form potential can 
carry. 

Regarding the large R limit, we consider that the zero modes B^J approach 
to zero but a new field Ai replacing 2ttRB^ survives the large R limit. The 
field Ai can not be viewed as part of the 2-form potential, in the sense that, 
due to the infinite scaling of B^ by i?, it can not be combined with B^ 
in a Lorentz covariant way to form a new tensor in 6 dimensions. Rather it 
should be understood as the 1-form needed to define gerbes (or some similar 
geometrical structure) together with the 2-form potential. However this does 
not increase the physical degrees of freedom of the 6 dimensional theory in 
the sense that the number of physical degrees of freedom in the 5 dimensional 
field Ai is negligible compared with that of a 6 dimensional field. 

The fact that gauge transformation laws do not have terms of the form 
[B^ KK \ A^^], and the fact that the equations of motion do not have terms 
of the form [B^ KK \B^ KK \ are both telling us that our model is linearized 
with respect to the 2-form potential. No self-interaction of the 2-form po- 
tential is present, and all interactions are mediated by the 1-form potential 
Ai. As the decompactification limit R — > oo is also the strong coupling limit 
g — > oo, we do not expect that the classical equations of motion could give a 
good approximation for the quantum theory. 
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On the other hand, the interpretation above allows us to understand some 
puzzles about the proposal of recent papers [23, 24] claiming that the 5 di- 
mensional D4-brane theory is already sufficient to describe the 6 dimensional 
M5-brane system even for a finite R. In their proposal, the momentum p§ in 
the 5-th (compactified) direction is represented by the "instanton" number on 
the 4 spatial dimensions. The first puzzle with this interpretaion is that, in 
the phase when U(N) symmetry is broken to U(l) , there is no instanton 
solution. But physically this corresponds to having M5-brane well separated 
from each other, and they should still be allowed to have nonzero p§. This 
problem does not exist in our model. In our model p§ is carried by the KK 
modes when the Lie algebra of the gauge symmetry is Abelian. Further- 
more, the Abelian case of our model is already known to be equivalent to a 
6 dimensional theory which has the full Lorentz symmetry in the large R limit. 

The second puzzle of their proposal is that the instanton number only gives 
the total value of p§ of a state, and there is no way to specify the distribution 
of ps over different physical degrees of freedom. For example, the state with 
m units of p§ contributed from the scalar field X 1 and n units of from X 2 
cannot be distinguished from the state with the numbers m and n switched. 
A possible resolution of this puzzle is that, perhaps due to strong interactions, 
we can no longer distinguish different distributions of p$ over different degrees 
of freedom. In other words, it is unphysical to specify the distribution of p§. 
If true, this would be a mysterious phenomenon, but we can not rule out this 
possibility, as we know very little about how to label physical degrees of free- 
dom in a strongly correlated system. 

In our model, the instanton number of the 1-form Ai = RB^ should only 
be interpreted as the value of p$ of the field Ai. In other words, the so-called 
"zero-modes" B^ can still carry nonzero p§. The 5-th momentum of the 2- 
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form potential is manifest as the KK mode index. The scalar fields X and 
the fermions when they are introduced into our model, would have their 
own KK modes to specify their p$ contribution. There is no ambiguity in the 
momentum carrier for a given instanton number. 

The reader may wonder whether it is redundant or over-counting for A{ to 
be able to carry nontrivial p§. After all, Ai is just B^ rescaled. Has not the 

(KK) 

KK modes B ib already taken care of the contribution of B^ to p$l How 
can a field carry momentum in the ar -direction if it has no fluctuation (e.g. 
propagating wave) in that direction? The answer is simple. It is well known in 
classical electrocmagnetism that the simultaneous presence of constant elec- 
tric and magnetic fields carry momentum, because the momentum density pi 
is proportional to F° 3 Fij. In the temporal gauge , Aq = 0, the conjugate 
momentum of Aj is U J = d$A ] and the momentum density pi is proportional 
to 

F^Fij = WidiAj) - W(djAi). (217) 

The first term is the standard contribution of a field to momentum pi. We also 
have (do4>) (di4>) for a scalar field 0. But there is no analogue of the 2nd term 
for a scalar field. It is possible for the 2nd term to be present because Ai has a 
Lorentz index. The zero mode of Ai in the x l direction can also contribute to 
Pi through this term. Similarly, for a 3-form field strength H, the momentum 
density of p§ is proportional to Ho a bH ab5 (a, 6 = 1,2, 3, 4), which includes the 
zero mode contribution 

H ol Fab = l^abcd 5 F ab F cd (218) 

because H^ 5 = F^. This is precisely the same expression as the instanton 
number density. Note that there are also contributions to p§ from the KK 
modes H^ K) H^ ab5 in addition to the zero mode contribution. 
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6 BRST-Antifields Quantization on Non-Abelian 2-Form 
6.1 BRST Symmetry of Non-Abelian 2-form 

The quantization of self-dual fields is a long-standing subtle problem. It was 
argued [25] that even we have a classical action of self-dual gauge fields; we 
do not expect to quantize the theory from the action. That means that a 
self-dual p-form might need to be treated quantum mechanically in the very 
beginning. 

One approach toward a quantized M5-brane (self-dual fields) was also de- 
veloped in [25]. It suggested that one can start from a non-chiral action, which 
has a well-defined partition function denoted by Z, then consider write Z as 
an absolute value squared of the chiral fields' partition functions. Thus as an 
intermediate step toward the quantization of M5-branes, it will be useful to 
firstly consider Z, which corresponds to the partition function of non-Abelian 
2-form potential without the self-duality condition. In this section, although 
the Lorentz covariance is still broken, we investigate the BRST transforma- 
tion laws of this non-local non-Abelian 2-form gauge theory and we will give 
a BRST invaraint gauge-fixed action which is desirable before having a well- 
defined partition function. 

The quantization of reducible gauge theories is not that straightforward. 
As we know, a gauge-fixing procedure is needed to render dynamical degrees of 
freedom by using ghost fields, which are used to compensate for the gauge de- 
grees of freedom. In reducible gauge theories, some so-called "ghosts of ghosts" 
will be needed and the ordinary Faddeev-Popov procedure become quite com- 
plicated for this kind of reducible theories. Here we will use BRST-antifield 
formulation (or Batalin-Vilkovisky method [33]) to deal with this situation. 
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The Yang-Mills-like action for the non-Abelian 2-form is given by 

S = S^ + S^ KK \ 



where 



S (o) = 

g(KK) 



2ttR 



d 6 x Tr 



d 5 x Tr 



1,1 



1 



(219) 

(220) 
(221) 



where we separately define zero modes and KK modes as we did before. We 
consider a standard form of the action that is different from the self-dual 
action. At first we will need to find the existence of the BRST transformation 
laws of this theory where gauge parameters such as 



A (0) .(KK) a (KK) 



(222) 



become "ghost fields" with fermionic statistics and join BRST transformation 
laws. In the following we use the some notations for these gauge parameters 
as before but we should re-interpret gauge parameters as ghost fields. 

The BRST transformation laws denoted by the BRST operator s for this 
non-local non-Abelian 2-form theory are given by 



sB 



(0) 



sB 
sB 



ib 

{KK) 
ib 

(KK) 
ij 



[A,A< 0) ] 

lD h A.r ) l-d^ KK) + 9lB£ K \^ ) 
[A, Af A '»] - [Djkf K) ] + glBij, A 



L 5 

(0) 
L 5 



sA 



(0) _ 



#r A (0) A (0) 
"2 



sA 
sA 



(KK) 
5 

(KK) 



%«-#f,AS^] 

[A,«]- 9 [A?»Ar] 

(O)i 



sa = g[a,A K 5 } ] 



(223) 
(224) 

(225) 
(226) 

(227) 
(228) 
(229) 



where a is a commuting ghost representing the redundancy in the theory. No- 
tice that a appears only as the KK mode but we ignore the KK index for the 
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simplicity. We will not use A) explicitly just like we do not use B\ explicity 
throughout the theory. The BRST operator s has ghost number one and the 
ghost of ghost "a" has ghost number two which can be read from the BRST 
transformation laws. The role of a is to fix the residual degrees of freedom 
coming from the gauge symmetry of gauge symmetry of the theory as men- 
tioned above. 

These BRST transformation laws satisfy 

s 2 = (230) 

which is the nilpotency condition for the BRST transformation. The existence 
of the BRST symmetry is crucial for the further analysis on quantizaton of 
a gauge thoery. Physical observables are defined as those BRST invariant 
(closed form) but can not be expressed as a BRST variation of something 
(exact form). In short, observables correspond to the elements of the BRST 
cohomology. 



6.2 Field- Antifield Quantization on Non-Abelian 2-form 

Now we consider the gauge fixing process following the field-antifield method 
[33], where the original configuration space will be enlarged to include extra 
fields such as ghost fields and ghosts for ghosts. The minimal action is given 
by 

S = + K) (231) 
where zero modes' part is given by 

S<°> = *0* I ctx Tr[(F«F y + B-<^(lD„ A<°> ]) - A*<°>(f[Af , A<°» ])j>32) 
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and KK modes' part is given by 

si KK) = J dfx Tr { [Jll^lfy + + B" KK ^([D„ AfV] - d.A, 

+g[B l i K \ A<°>]) + B«(^)«([A, Af K) ] - \Djh\ KK) ] + g\B ih A<°> ] 
-fflF^a^AP''])] + A*<^»(a 5 a - ff [A<°», AP'»]) + A*<^')'([A,«] 
-jIAfUnJ+a'^KAf])} (233) 

where (B*5™, B*j KK \ Bf\ A* (0) , A* ( ™», A* <AA ', a*) are antifields introduced 
as the sources of the BRST transformation laws of corresponding gauge fields. 
The ghost number's relation between a field and its corresponding antifield is 
given by 

gh($) + gh($*) = -1 (234) 

which can be read from the fact that the action has vanishing ghost number. 
We also notice that the relation of (mass) dimension between a field and its 
corresponding antifield is D(<&) + D(§*) = 6, thus for instance, D{B llv ) = 2 
so that D(B*„) = 4, and the coupling constant has D(g) = —1. 

Antifields will be eliminated by using the so-called gauge-fixing fermion ^ 

via 

*' - w (235) 

which means that the partition function constructed with a gauge-fixed effec- 
tive action is given by 

Z = J V^V^d^ 1 - J^y) (236) 

where $ J represents all fields in the theory. Since \I/ must be a functional of 
fields only (not antifields) and its ghost number is —1, we see that it is not 
possible to write down an acceptable gauge fermion unless we introduce extra 



•56 



fields. Thus we introduce so-called trivial pairs (or doublet) which defined by 
(A,B) with the following relation 

sA = B (237) 
sB = (238) 

notice that the transformation of B is simply the consequence of the nilpo- 
tency of A. 

The zero modes' part is an irreducible system, it turns out that it is suffi- 
cient to introduce only one doublet. For the KK modes' part, it is a reducible 
system and we will introduce three pairs. The extend actions are defined as 

= 4 0) ~^Jd 5 x Tr D*E (239) 

SgW = S^ K) - J d Q x Tr (a*% + A* 5 6 5 + ab - u;*tt) (240) 

where we introduce doublets 

(D, E) for zero modes. 

(A^&J, (a,b), (u, it) for KK modes (241) 
note that fields in the same doublet have the same (mass) dimension. 

As an example, let us consider the gauge fermion \I/ as 

^(0) = I d , x Tr D{ _E_ + diB ^ (242) 

4 J 2,r/ 

^ KK ) = J d 6 x Tr (k\&B% K) + d 5 B { « K) + diuj) 

+K\d l B i i K) + d 5 u) + ad^kf K ^ (243) 
where r/ is an adjustable parameter. By = |)| (recall that ^ is a functional 
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of fields only), we obtain the gauge fixing actions 
S ff = ^/^Tr[(F(°)^)-a'S([A,Af]) + (^-a'4°>)E](244) 

-d^'< K >\[D,,Kf K) ] - ds4 KK> +fl[S*f K> ,Af ]) 
-c/A<™> 5 ([A, Af K >] - *aS**> + fl [B<™, Af ]) 
-3*™W([A,Af K >] - M™>] +fl[B«,Af] - fllFo-^-'Af "]) 

-a 5 a(a 5 « - ff [Af, Af' f >]) - a'a([A:,«] - <uA< 0) ,aP°]) 

-i&'Kf K) )b - (d'Ai + d r 'h)7r\ (245) 

it is interesting to notice that these gauge-fixed actions are indeed invaraint 
under BRST transformation laws 

s(S^) = (246) 
s{Sf f K) ) = (247) 

and there is no other gauge symmetry left. After we intergrate auxiliary fields 
out, the guage fixing conditions can be read as the following covaraint forms: 

^4 0) = | (248) 

d v B^ + d^uj = (249) 

d»kf K) = (250) 

= (251) 

if we take the parameter 77—7-00, then the Lorenz gauge will be imposed as a 
delta-function condition for zero modes. The Lorentz covariance is still broken 
for KK modes part. The gauge fixing process here is similiar with the case 
when we deal with the Abelian 2-form theory. 
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As for the counting of the degrees of freedom (Recell that a gauge field 
has many components while only some of those describe physical degrees of 
freedom. The other degrees of freedom correspond to unphysical degrees of 
freedom. The ghost fields' degrees of freedom subtract since they represent 
these unphysical parts), the two-form potentials give +15, while ghost fields 

and A M both give —6, then u, a and a all give +1. In total we have 15-6- 
6+1+1+1=6 physical degrees of freedom, and that is the expected answer for 
a 2-form potential theory. 

Denote S e ff as the effective action that has already intergrated out all 
auxiliary fields in S g f above. The partition fuction for this non-abelian 2-form 
theory could be formally given by 

= J VB^Vkf VD SfiB® - -) e^°ff (252) 
Z (KK) = f VB^VKf^VKf^VujVaVa 

5{d u B^ + d^u) 5(d»Kf K) ) 5(d»A„) e* 5 -" (253) 

where the field D in zero modes' part is sometimes referred as the anti-ghost 
field in the standard Yang-Mills theory. 

One may wonder whether it is possible to start from a standard Yang-Mills- 
like action as the classical action to obtian the self-duality condition in the 
partition function level via enlarging the configuration space through field- 
antifield formulation. The final partition function should look like (for KK 
modes) 

Z (kk) = f VB f v K )vk^vW VvuVaVa 

S(PB$V + d,Cu) 5{d»kfV) 5(d^A fJ ) 5(H - *H) ij5 e&t? 

(254) 

where (H — ^5 represents the self-duality condition. Following the method 
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of field-antifield formulation, the corresponding extra/extend action should be 



where (Pjj, Qij) forms a triviar pair. And the corresponding extra gauge 
fermion should be 



so that in the end we will have a delta function that gives the self-dualty 
condition on the partition function after intergrating out Qij. However, the 
result introduces extra degrees of freedom that come from the kinetic terms 
of P(j, which indicates that this naive approach for a self-dual theory does not 
work. 




(255) 




(256) 
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7 A Generalization: Non-Abelian 3-form 



In this section we construct non-Abelian gauge theory for a 3-form potential. 
Readers who want to focus on the theory of M5-branes might simply skip this 
section for the first reading. 

We first study the Abelian gauge theory for a 3-form potential on the 
spacetime of 

K d x T 2 (257) 

Let the torus T 2 extend in the directions of x 1 and x 2 . We can decompose a 
field <£> as 

$ = $(0) + $(**0 (258) 
where the zero mode §^ has no dependence on T 2 

6> a $ (0) = 0, (259) 
and the KK mode & KK > can be obtained from $ as 

$(kk) = D -i Mj (260) 

where 

U = d a d a (a =1,2). (261) 
The Abelian gauge transformations of a 3-form potential B are given by 

5B il2 = diA u - dvtiu + QiAii, (262) 
SBija = diAja - djA ia + d a Aij, (263) 
SB ijk = diAjk + djAki + dkAij, (264) 

where a = 1, 2 and k = 0, 3, 4, • • • , [d + 1). There is redundancy in the 
gauge transformation parameters Aj a , Am so that the gauge transformation 
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laws are invariant under the transformation 



Mi 2 = <9iA 2 -<9 2 Ai, (265) 
5A ia = d,\ a - d a \, (266) 
My = diXj-djXi. (267) 

Apparently there is also a redundancy in using A to parametrize the redun- 
dancy in A. There are (d + 2) components in A, but only (d + 1) of them are 
independent. Using the redundancy of A, we can "gauge away" (d + 1) of the 
gauge transformation parameters. For instance, we can set 

Pi = d a A m = 0, A 12 = 0, (268) 

and use the following gauge transformation parameters 

£ = e ab d a A lb , Aij, (269) 

so that 

A { « K) = -e^n- 1 ^, (270) 
and the gauge transformation laws become 

SB il2 = (271) 
SB ija = -<r b n- 1 d b {d i £ j -d j & + d a A ijl (272) 
5B ijk = diAjk + djAui + dkAij. (273) 

Viewing A ia as d copies of 1-form potentials on T 2 , the £$'s are the cor- 
responding field strengths, and so their integrals over T 2 are quantized. It 
implies that Q is quantized, and so we have to set 

4 (0) = (274) 

when we use ^ as infinitesimal gauge transformation parameters. In the fol- 
lowing, we have ^ = & KK \ 
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Since the original gauge transformation laws have the redundancy, one can 
simply carry out the replacement 



& (i-diA 12 , (275) 

kij A iJ - + n- 1 (a<p i -a i /? i ). (276) 

On the torus T 2 , the gauge transformation parameter corresponds to a 
Wilson surface degree of freedom for the 2-form A. 



To construct a consistent non-Abelian gauge transformation algebra for 
the 3-form potential, we only need to consider transformation laws for the 
parameters Q K K , and A^ . In the end we get the full gauge transformation 
laws through the replacement 

^ -> [A, A<?*>], (277) 

+ D_1 ([A, pf *>] - [A. ft'" ]), (278) 
where the covariant derivative A should be defined as 

A = $ + (279) 

and 

tf K) ee e" b d a A$ K \ pf K) ee 9°A«f K \ (280) 

Here we have scaled A12 to absorb the coupling constant g, which is expected 
to be given by the area (2tt) 2 RiR2 of the torus. 

We define the non-Abelian gauge transformations as 

6B m = [A,AS° 2 ) ]-e i + [4^US° 2 ) ], (281) 

SB ija = -c o6 n- 1 ^([A,&]-[^6]) + ^A y 

+[D i: A^]-[D j: AfJ] + [B ija .A^}, (282) 
££ iifc = [A, Aifc] + A w ] + [A, Aij\ + [%*, Ag } ]. (283) 
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The algebra of gauge transformations is closed 

P, 6'} = 8\ (284) 

with the parameters of 5" given by 

A<°>" = [ASUS''], (285) 
C" = te.A&'l-l&Ag'], (286) 
A"j = [A iy ,Ag»']-[A; 3 ,Ag»]. (287) 

The field strengths should be defined as 

H\% = [D„D,\, (288) 
<? = [A, - [% 4^'] + ejH**> - DtBfiP, (289) 

-e ab B-% ([% 5™] + B<g*>] + [F H> B<£*>]) ,(290) 
Hijki = ^2lDhB jkl ]-Y^[Fij:M: (291) 

(4) (6) 

where 

Pij = n~ l d a B ija , (292) 
so that all the field strength components transform as 

SH ijl2 = [H ijl3 ,A®], (293) 
SH ijka = [H t:]ka ,A^]+J2i F ^ Ai k^ ( 294 ) 

(3) 

SH m = [H ijkh A^]+Yll F ^ A ki}- (295) 

(6) 

It may be possible to define a non-Abelian self-dual gauge theory for a 
3-form potential in 8 dimensional Euclidean space. And the same idea can 
be used to define a non-Abelian gauge symmetry for p-form potentials on 
H d x T p ~ l . We leave these generalizations for future study. 
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8 Toward non-Abelian PST and Conclusion 



8.1 Toward non-Abelian PST 

The most interesting open problem is to find a manifest Lorentz-covariant 
formulation of the non-Abelian self-dual 2-form theory. The covariant the- 
ory sould reproduce the previous 5+1 non-covariant formulation under proper 
conditions. That is, the question here is: Could we have a non-Abelian PST- 
like formulation for multiple M5-branes? 

Let me conclude this thesis by stressing some difficulties when one wants to 
find an manifest Lorentz-covariant formulation of this non-Abelian self-dual 
2-form theory by using the similar ideas people (like PST) came up: introduc- 
ing auxiliary fields. 

We first notice that in the case of non-Abelian chiral 2-form theory here, the 
non-covaraincy are in fact two-fold. In the Abelian case, the field strengths H 
are defined covariantly. (This means that its Maxwell-like action is Lorentz co- 
varaint), we then start to consider how to have an abelain covariant self-dual 
action (Abelian PST action). In the non-Abelian case, the Yang-Mills-like 
action (s = J H 2 ) is still not Lorentz covariant since our defination of field 
strengths are not covaraint. One can check that the transformed field equa- 
tion of the Yang-Mills-like action of the non-abelian 2-form theory under the 
standard Lorentz transformation is NOT up to the field equation itself, this, 
in some sense, might indicate we are still in a gauge. In another word, one 
observes that is absent in the algebra, which is like the axial gauge that 
violates Lorontz invariance, however the symmetry should be restored in the 
calculation of gauge-invariant S-Matrix elements. 

Assuming we have a covariant version of the non-abelian 2-form theory, 
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which means that we assume H pv \H^ vX is Lorentz invariant (we will discuss 
about it more later). Is it possible to have a non-Abelian PST action? Let us 
introduce an "Abelian" auxiliary field b(x) to construct the covariant self-dual 
theory 10 . Let us directly non-abelianize the Abelian PST action by 

S = \j ' A Tr ( - ^H^H^x + \u^P;U» V(J ) (296) 

the variation of the action 11 gives: 

6S = J d 6 x Tr (e a ^ x d,b[D pi H uX ](5B a p) ~ e a ^ vX d,bd p H uX H aP (5bJ^97) 

then the claim is that we still have the extra symmetry under the gauge 
parameter 0: 

5B° P = H;j (298) 
5b = (j) (299) 

where a is the group index, if we need to introduce other fields, we simply let 
£(Other Fields) = 0. To check that, we see that the ordinary derivatives part 
are cancelled as in the abelian PST case. The extra term is: 

e a ^%b n c A h p H c vX H a a ^ = (300) 

where fg c is the structure constant. We see this term "vanish identically" 
since there are three total antisymmetry indices on H%\- Also notice that the 
equation of motion of b(x) does not give extra constraint since it vanishes up 
to the self-duality condition. After fixing b = a; 5 , we have 

= -^T M5 T M \ J d 6 x Tr (2H ijk H^ k + ^ klm E klm d h B %3 ) (301) 

10 The reason for the "Abelian" field is that we hope the field b(x) could be fixed to x 5 in the end, and 

x 5 should not take a matrix value. 

11 Here we consider H. flv \ = [D p , B v \] + [D v , B\^] + [D\, B^ v \ for a covaraint non-abelian 2-form theory 

in a proper gauge condition by using B. And we let the connection as A^. We discuss these issue more 

later 
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which is the previous non-covariant multiple M5-branes action that gives the 
self-duality condition for the two-form potential. 

However, we will see the main challenge is to have a covariant version of 
the non-Abelian 2-form theory (without self-duality), which means that it is 
unclear how to define H^ v \ so that L ~ H lJLV \H^ vX is Lorentz invariant. 

Naturally, one might introduce another Abelian auxiliary field aAx) to de- 
fine the covariant non-Abelian 2-form theory and the previous non-covaraint 
algebra (gauge transformation laws and 3-form field strengths) could be ob- 
tained by an extra gauge fixing. Let us now consider this approach. 

First we will consider a five dimensional one-form potential A(x l ) appears 
as the new field replacing RB^ in large R limit and we separately define the 
zero modes' part when reducing to multiple D4-branes. Let our notation as 
fi, v, A... = 0, 1, 2, 3, 4, 5 and k.. = 0, 1, 2, 3, 4 and we also use the non-local 
operator which only consistently acts on the KK-modes that dominate contri- 
butions in 6D (In the following, we will ignore the index of (KK) notation). We 
define the covariant non-Abelian gauge transformation law of 2-form potential 
in 6D as: 

SB^ = [D^ K] - [D v , AJ + [B^, A] - [F^ {a ■ 0)~ VAJ (302) 

Where a^{x) is the U(l) auxiliary spacetime-dependent field that is used to co- 
variantize this non-abelian 2-form theory (Note that a(x) is not b(x). The field 
b(x) is used to covariantize a self-dual theory). Here the covariant derivative is 
defined in terms of the one-form potential: = + A^. It is interesting to 
understand more about the physical meaning of this one-form potential such 
as what happens when it comes to the compactification so that the role of 
A is mapped to the zero modes B^. Notice that if A field is determined by 
other fields, it will directly contradict the recent result that the theory is triv- 
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ial when one only uses (2,0) tensor multiplets [27], thus one needs to consider 
this A-field as the new field in the interacting 6D theory. We conjecture that 
these new degrees of freedom should relate to the condensation of tensionless 
strings in M5-branes. We will discuss this A-field more later and in particular 
we will see this A-field is indeed the five-dimensional field hence it will not 
influence the degrees of freedom in six-dimensions. 

We also define F^ v = [D^D V ], SA^x) = [Z) M , A], 5a^(x) = 0. Note 
that we will not introduce any coupling constant due to the conformal nature 
of M5-branes. Then, again, to be justified as the deformation of Abelian 2- 
form theory, the gauge transformation of B-field should be invariant under the 
"redudent transformation" 

6A lt = [D lt ,a] (303) 

we find that this symmetry exists only if 

o% = (304) 

The consequence of this condition is that if we fix a direction for a, says the 
5-th direction, then the component A§ will decouple from the theory, which is 
consistent with the previous model where A§ is absent. 

Notice that the gauge transformation on the condition (304) gives 

a^[D^.\] = (a-d)X = (305) 

as a consistency constraint on A. This tells us A is a five-dimensional param- 
eter, as expected. 

One can check that the gauge algebra is closed by: 

[S h 6 2 ] = S 3 (306) 
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with 

A 3 = [Ai,A 2 ] (307) 
A A , 3 = [A^AJ-IA^AJ (308) 

thus it is indeed possible to have a covariant version of the non-Abelian 2-form 
gauge transformation (302). We will, however, face problems when we try to 
define 3-form field strengths. 



If we use the form as previous non-covariant formulation to define 3-form 
field strengths, we should define 

H^x = B,a] + ft, 5^] + [2? A , 5 J + [F FI (o • a)"^] 

+ [F, A ,(a-a)-V5j + [F AM ,(a.5)-V5j (309) 

if we ask this field strength transforms covariantly, that is 

6H IU , X = [H IU/X ,\] (310) 

we will need 

a^F^ = (311) 

which is consistent with the fact that is a five-dimensional field after a 
preferential choice of the vector a^(x). However, we will also need to impose 
constraints on gauge parameters and A 

(a -5) ft, A] = (312) 
(a-d)-Vft,AJ = ft, (a • <9)-VA p ] (313) 

the problem is that these constraints on gauge parameters are too strong and 
it is almost saying that the field a M is constant, which means that there is no 
manifest Lorentz symmetry. 
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Furthermore, since we do not want to put equations (304), (311) by hand 
that contradicts the action principle. The two constraints on fields: a^A^ = 
0, a^F^y = should be solved simultaneously. One can, for instance, indeed 
solve them by letting: 

a x = (8 v x -x- 2 x x x v \b v (314) 
A a x = x x [l-{a-d)- l {a-d)]C a (315) 

where a is group index and x\ is the spacetime coordinate. And we introduce 
field B v (Abelian field), and field C a . But the solution means that the de- 
grees of freedom of A are too small. Moreover, we should still need to find a 
"universal redundant" hidden symmetry for a(x) that allows us to reduce: 

5B^ = [Dp, Ay] - [A, AJ + [B^p, A] - [F^ (a ■ 0)"VA p ] (316) 

to 

6Bij = [A, A,] - [Dj, Ai\ + [B& A] - [F ih d, l A h ] (317) 
and also allows us to reduce 

H[j,i,\ = [£>„, By X ] + [A, Bxfi] + [A, B^] + [F^, (a ■ d)- l a p B Xp ] 

+ [F, A ,(a-a)-V5j + [F v ,(a.a)-V5j (318) 

to 

Hijk = [A, Bjk] + [Dj, B ki ] + [A, Bij] + [Fij, d 5 1 B k5 ] 

+ [F jk , d^Bx] + [Ffcf, d^Bjs] (319) 

but it is not clear how to achieve them unless there are indeed constraints 
allowed on gauge parameters. At present we do not know the full answer to 
these questions, we left it for future study. 
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8.2 Conclusion 

In this thesis, we discuss various formulations of chiral fields in different dimen- 
sions, including non-covaraint and covariant formulations. We mostly focus 
on the formulation of chiral two-form in six-dimensions. After reviewing the 
Abelian theory, we construct gauge transformation laws, equations of motion 
and an action for its non- Abelian generalization. The new ingredient as com- 
pared to previous approaches is the non-locality in the compact direction. We 
expect that this model could be used to describe multiple M5-branes. 

We also comment on this model about its decompactified limit and com- 
pared it with other approaches on M5-branes system. We also consider the 
BRST-antifield quantization of this non- Abelian 2-form gauge theory and gen- 
eralize the algebra to construct non- Abelian 3-form gauge theory. Finally we 
see difficulties when trying to find a manifest Lorentz-covariant theory by uti- 
lizing extra auxiliary fields. 

There are some main open problems: 

1. A well defined R — > oo limit of the theory with the 6D Lorentz symmetry. 

2. The supersymmetric extension of the theory. 

3. The quantization of the theory. 

It is fair to say that the full structure of M5-branes is still highly mysterious 
and further investigation is certainly needed. 



71 



9 Acknowledgments 



I would like to express my gratitude to my advisor, Pei-Ming Ho, for his guid- 
ance and for introducing me to the study of M5-branes theories. I appreciate 
his inspiration and the great efforts to explain everything clearly. I benefited 
from many people when discussing this topic: Wei-Ming Chen, Yen-Ta Huang, 
Sheng-Lan Ko, Fech-Scen Khoo, Yi-Chuan Lu, Chen-Te Ma, Yutaka Matsuo, 
Chi-Hsien Yeh and Chen-Pin Yeh. I am also grateful to Chuan-Tsung Chan 
and Wen-Yu Wen for being my thesis defense committee. Finally, I would like 
to thank my parents, Wung-Hong Huang and Li-Hua Lai, for their constant 
support and encouragement. 



72 



References 

[1] P.M. Ho, K.W. Huang and Y. Matsuo, "A non-abelian self-dual gauge 
theory in 5+1 dimensions", JHEP 1107 (2011) 021 [1104.4040 [hep-th]]. 

[2] J. Bagger, N. Lambert, S. Mukhi, C. Papageorgakis, "Membranes in 
M-theory," Physics Reports (2012) [arXiv: 1203.3546 [hep-th]]. N. Lam- 
bert, "M-Theory and Maximally Supersymmetric Gauge Theories" (2012) 
[arXiv:1203.4244[hep-th]] D. S. Berman, "M-theory branes and their in- 
teractions," Phys. Rept. 456, 89 (2008) [arXiv:0710.1707 [hep-th]]. 

[3] J. Bagger and N. Lambert, "Modeling multiple M2's," Phys. Rev. D 75, 
045020 (2007) [arXiv:hep-th/0611108]. J. Bagger and N. Lambert, "Gauge 
Symmetry and Supersymmetry of Multiple M2-Branes," Phys. Rev. D 
77, 065008 (2008) [arXiv:0711.0955 [hep-th]]. J. Bagger and N. Lam- 
bert, "Comments On Multiple M2-branes," JHEP 0802, 105 (2008) 
[arXiv:0712.3738 [hep-th]]. A. Gustavsson, "Algebraic structures on par- 
allel M2-branes," arXiv:0709.1260 [hep-th]. 

[4] Ofer Aharony, Oren Bergman, Daniel Louis Jafferis, Juan Maldacena, 
"N=6 superconformal Chern-Simons-matter theories, M2-branes and their 
gravity duals" JHEP 0810:091,2008 [arXiv:0806.1218[hep-th]] 

[5] A. Strominger, "Open p-branes," Phys. Lett. B 383 (1996) 44 [arXiv:hep- 
th/9512059]. 

N. Seiberg, "Nontrivial fixed points of the renormalization group in 
six-dimensions," Phys. Lett. B 390, 169 (1997) [arXiv:hep-th/9609161]. 
E. Witten, "Five-brane effective action in M theory," J. Geom. Phys. 22, 
103 (1997) [arXiv:hep-th/9610234]. N. Seiberg, "Notes on theories with 



73 



16 supercharges," Nucl. Phys. Proc. Suppl. 67, 158 (1998) [arXiv:hep- 
th/9705117]. 

[6] I. R. Klebanov and A. A. Tseytlin, "Entropy of Near-Extremal Black 
p-branes," Nucl. Phys. B 475, 164 (1996) [arXiv:hep-th/9604089]. S. S. 
Gubser, I. R. Klebanov and A. A. Tseytlin, "String theory and classical 
absorption by three-branes," Nucl. Phys. B 499, 217 (1997) [arXiv:hep- 
th/9703040]. S. S. Gubser and I. R. Klebanov, "Absorption by branes and 
Schwinger terms in the world volume theory," Phys. Lett. B 413, 41 (1997) 
[arXiv:hep-th/9708005]. M. Henningson and K. Skenderis, "The holo- 
graphic Weyl anomaly," JHEP 9807, 023 (1998) [arXiv:hep-th/9806087]. 
F. Bastianelli, S. Frolov and A. A. Tseytlin, "Conformal anomaly of (2,0) 
tensor multiplet in six dimensions and AdS/CFT correspondence," JHEP 
0002, 013 (2000) [arXiv:hep-th/0001041]. 

[7] N. Lambert and C. Papageorgakis, "Nonabelian (2,0) Tensor Multiplets 
and 3-algebras," JHEP 1008 (2010) 083 [arXiv:hep-thl007.2982]. 

[8] W. M. Chen and P. M. Ho, "Lagrangian Formulations of Self-dual 
Gauge Theories in Diverse Dimensions," Nucl. Phys. B 837, 1 (2010) 
[arXiv: 1001.3608 [hep-th]]. 

[9] Wung-Hong Huang, "Lagrangian of Self-dual Gauge Fields in Various For- 
mulations", Nucl. Phys. B861, pp. 403-423 (2012) [arXiv:1111.5118 [hep- 
th]] 

[10] P. Pasti, D. P. Sorokin and M. Tonin, "Note on manifest Lorentz and 
general coordinate invariance in duality symmetric models," Phys. Lett. 
B 352, 59 (1995) [arXiv:hep-th/9503182]. P. Pasti, D. P. Sorokin and 
M. Tonin, "Duality symmetric actions with manifest space-time symme- 

74 



tries," Phys. Rev. D 52, 4277 (1995) [arXiv:hep-th/9506109]. P. Pasti, 
D. P. Sorokin and M. Tonin, "Space-time symmetries in duality symmet- 
ric models," arXiv:hep-th/9509052. P. Pasti, D. P. Sorokin and M. Tonin, 
"On Lorentz invariant actions for chiral p forms," Phys. Rev. D 55, 6292 
(1997) [arXiv:hep-th/9611100]. P. Pasti, D. P. Sorokin and M. Tonin, "Co- 
variant action for a D = 11 five-brane with the chiral field," Phys. Lett. 
B 398, 41 (1997) [arXiv:hep-th/9701037]. 

[11] P. S. Howe and E. Sezgin, "D = 11, p = 5," Phys. Lett. B 394, 62 (1997) 
[arXiv:hep-th/9611008]. I. A. Bandos, K. Lechner, A. Nurmagambetov, 
P. Pasti, D. P. Sorokin and M. Tonin, "Covariant action for the super- 
five-brane of M-theory," Phys. Rev. Lett. 78, 4332 (1997) [arXiv:hep- 
th/9701149]. M. Aganagic, J. Park, C. Popescu and J. H. Schwarz, 
"World-volume action of the M-theory five-brane," Nucl. Phys. B 496, 191 
(1997) [arXiv:hep-th/9701166]. P. S. Howe, E. Sezgin and P. C. West, "Co- 
variant field equations of the M-theory five-brane," Phys. Lett. B 399, 49 
(1997) [arXiv:hep-th/9702008]. I. A. Bandos, K. Lechner, A. Nurmagam- 
betov, P. Pasti, D. P. Sorokin and M. Tonin, "On the equivalence of 
different formulations of the M theory five-brane," Phys. Lett. B 408, 
135 (1997) [arXiv:hep-th/9703127]. 

[12] P. M. Ho and Y. Matsuo, "M5 from M2," arXiv:0804.3629 [hep-th]. 
P. M. Ho, Y. Imamura, Y. Matsuo and S. Shiba, "M5-brane in three-form 
flux and multiple M2-branes," JHEP 0808, 014 (2008) [arXiv:0805.2898 
[hep-th]]. 

[13] P. M. Ho and Y. Matsuo, "A Toy model of open membrane field the- 
ory in constant 3-form flux," Gen. Rel. Grav. 39, 913 (2007) [arXiv:hep- 



75 



th/0701130]. 

[14] P. Pasti, I. Samsonov, D. Sorokin and M. Tonin, "BLG-motivated La- 
grangian formulation for the chiral two-form gauge field in D=6 and M5- 
branes," Phys. Rev. D 80, 086008 (2009) [arXiv:0907.4596 [hep-th]]. 

[15] K. Furuuchi, "Non-Linearly Extended Self-Dual Relations From The 
Nambu-Bracket Description Of M5-Brane In A Constant C-Field Back- 
ground," JHEP 1003, 127 (2010) [arXiv: 1001.2300 [hep-th]]. 

[16] P. M. Ho, "A Concise Review on M5-brane in Large C-Field Background," 
Chin. J. Phys. 48, 1 (2010) [arXiv:0912.0445 [hep-th]]. 

[17] C. H. Chen, P. M. Ho and T. Takimi, "A No-Go Theorem for M5-brane 
Theory," JHEP 1003, 104 (2010) [arXiv: 1001.3244 [hep-th]]. 

[18] L. Breen and W. Messing, "Differential Geometry of Gerbes," 
arXiv:math/0106083. J. C. Baez, "Higher Yang-Mills theory," arXiv:hep- 
th/0206130. P. Aschieri and B. Jurco, "Gerbes, M5-brane anomalies and 
E(8) gauge theory," JHEP 0410, 068 (2004) [arXiv:hep-th/0409200]. 
J. C. Baez and J. Huerta, "An Invitation to Higher Gauge Theory," 
arXiv: 1003.4485 [hep-th]. 

[19] A. Lahiri, "The dynamical nonabelian two form: BRST quantization," 
Phys. Rev. D 55, 5045 (1997) [arXiv:hep-ph/9609510]. R. R. Landim and 
C. A. S. Almeida, "Topologically massive nonabelian BF models in arbi- 
trary space-time dimensions," Phys. Lett. B 504, 147 (2001) [arXiv:hep- 
th/0010050]. A. Lahiri, "Local symmetries of the non-Abelian two-form," 
J. Phys. A 35, 8779 (2002) [arXiv:hep-th/0109220]. R. P. Malik, "Nilpo- 
tent (anti-)BRST symmetry transformations for dynamical non-Abelian 
2-form gauge theory: superfield formalism," Europhys. Lett. 91, 51003 

76 



(2010) [arXiv: 1005.5067 [hep-th]]. S. Krishna, A. Shukla and R. P. Ma- 
lik, "Geometrical Superfield Approach to Dynamical Non-Abelian 2-Form 
Gauge Theory," arXiv: 1008.2649 [hep-th]. 

[20] C. Hofman, "Nonabelian 2-forms," arXiv:hep-th/0207017. U. Schreiber, 
"Nonabelian 2-forms and loop space connections from SCFT deforma- 
tions," arXiv:hep-th/0407122. A. Gustavsson, "Selfdual strings and loop 
space Nahm equations," arXiv:0802.3456 [hep-th]. C. Saemann, "Con- 
structing Self-Dual Strings," arXiv: 1007.3301 [hep-th]. E. Bergshoeff, D. 
S. Berman, J. P. van der Schaar, and P. Sundell, "A noncommutative M- 
theory five-brane", Nucl. Phys. B 590 (2000) 173 [arXiv:hep-th/0005026]. 
A. Gustavsson, "Loop space, (2,0) theory, and solitonic strings", JHEP 
12 (2006) 066 [hep-th/0608141]. K.-W. Huang and W.-H. Huang, "Lie 
3-algebra non-abelian (2,0) theory in loop space", [arXiv: 1008.3834 [hep- 
th]]. C. Papageorgakis and C. Samann, "The 3-Lie Algebra (2,0) Ten- 
sor Multiplet and Equations of Motion on Loop Space," arXiv: 1103.6192 
[hep-th]. S. Palmer and C. Saemann, "Constructing generalized self- 
dual strings", [arXiv: 1105.3904 [hep-th]]. J.-L. Brylinski," Loop spaces, 
characteristic classes and geometric quantization", Birkha user Boston 
(2007). Sam Palmer, Christian Saemann, "M-brane Models from Non- 
Abelian Gerbes" (2012) [arXiv: 1203.5757 [hep-th]]. A. Gustavsson, "A 
reparametrization invariant surface ordering", JHEP 11 (2005) 035 [hep- 
th/0508243[hep-th]]. A. Gustavsson, "The non-abelian tensor multiplet in 
loop space", JHEP 01 (2006) 165 [hep-th/0512341[hep-th]]. A. Gustavs- 
son, "Selfdual strings and loop space Nahm equations", JHEP 04 (2008) 
083 [arXiv:0802.3456 [hep-th]]. 



77 



[21] M. Henneaux and B. Knaepen, "All consistent interactions for exterior 
form gauge fields," Phys. Rev. D 56, 6076 (1997) [arXiv:hep-th/9706119]. 
M. Henneaux, "Uniqueness of the Freedman-Townsend Interaction Vertex 
For Two- Form Gauge Fields," Phys. Lett. B 368, 83 (1996) [arXiv:hep- 
th/9511145]. M. Henneaux and B. Knaepen, "The Wess-Zumino consis- 
tency condition for p-form gauge theories," Nucl. Phys. B 548, 491 (1999) 
[arXiv:hep-th/9812140]. X. Bekaert, M. Henneaux and A. Sevrin, "Defor- 
mations of chiral two-forms in six dimensions," Phys. Lett. B 468, 228 
(1999) [arXiv:hep-th/9909094]. X. Bekaert, "Interactions of chiral two- 
forms," arXiv:hep-th/9911109. M. Henneaux and B. Knaepen, "A theo- 
rem on first-order interaction vertices for free p-form gauge fields," Int. 
J. Mod. Phys. A 15, 3535 (2000) [arXiv:hep-th/9912052]. X. Bekaert, 
M. Henneaux and A. Sevrin, "Chiral forms and their deformations," Com- 
mun. Math. Phys. 224, 683 (2001) [arXiv:hep-th/0004049]. X. Bekaert 
and S. Cucu, "Deformations of duality symmetric theories," Nucl. Phys. 
B 610, 433 (2001) [arXiv:hep-th/0104048]. 

[22] E. Witten, "Conformal Field Theory In Four And Six Dimensions," 
arXiv:0712.0157 [math.RT]. E. Witten, "Geometric Langlands From Six 
Dimensions," arXiv:0905.2720 [hep-th]. 

[23] M. R. Douglas, "On D=5 super Yang-Mills theory and (2,0) theory," JHEP 
1102, 011 (2011) [arXiv: 1012.2880 [hep-th]]. 

[24] N. Lambert, C. Papageorgakis and M. Schmidt-Sommerfeld, "M5-Branes, 
D4-Branes and Quantum 5D super- Yang-Mills," JHEP 1101, 083 (2011) 
[arXiv: 1012.2882 [hep-th]]. 

[25] Edward Witten, "Duality Relations Among Topological Effects In String 

78 



Theory", JHEP 0005:031,2000 [arXiv:9912086[hep-th]] E. Witten, "Five- 
branes and M theory on an orbifold," Nucl. Phys. B 463, 383 (1996) 
[arXiv:hep-th/9512219]. 

[26] H. Samtleben, E. Sezgin, and R. Wimmer, (1,0) superconformal models in 
six dimensions, JHEP 1112 (2011) 062, [arXiv: 1108.4060 [hep-th]]. C.S. 
Chu, A Theory of Non-Abelian Tensor Gauge Field with Non-Abelian 
Gauge Symmetry G x G,[ arXiv: 1108.5131 [hep-th]]. H. Samtleben, E. 
Sezgin, R. Wimmer, and Linus Wulff, New superconformal models in six 
dimensions: Gauge group and representation structure, [arXiv: 1204.0542 
[hep-th]]. B. Czech, Yu-tin Huang, and Moshe Rozali, Amplitudes for 
Multiple M5 Branes, [arXiv: 11 10.2791 [hep-th]]. 

[27] Y.T. Huang, A. E. Lipstein, "Amplitudes of 3D and 6D Maximal 
Superconformal Theories in Supertwistor Space" JHEP 1010:007,2010 
[arXiv:1004.4735v3 [hep-th]] 

[28] D. Belov and G. W. Moore, "Holographic action for the self-dual field", 
[arXiv:0605038 [hep-th]] 

[29] M. Perry, J. H. Schwarz, "Interacting Chiral Gauge Fields in Six Dimen- 
sions and Born-Infeld Theory", Nucl. Phys. B489 (1997) 47-64, [arXiv: 
9611065vl [hep-th]] 

[30] W. Siegel,"Manifest Lorentz invariance sometimes requires nonlinearity," 
Nucl. Phys. B238 (1984) 307. 

[31] R. Floreanini and R. Jackiw, "Selfdual Fields As Charge Density Solitons," 
Phys. Rev. Lett. 59, 1873 (1987). 

[32] B. McClain, F. Yu and Y. S. Wu, "Covariant quantization of chiral bosons 



79 



and Osp(l,l|2) symmetry," Nucl. Phys. B 343 (1990) 689. C. M. Hull, 
"Covariant quantization of chiral bosons and anomaly cancellation," Phys. 
Lett. B 206 (1988) 234. J. M. Labastida and M. Pernici, "On the BRST 
quantization of chiral bosons, Nucl. Phys. B 297 (1988) 557. L. Mezincescu 
and R. I. Nepomechie, "Critical dimensions for chiral bosons", Phys. Rev. 
D 37 (1988) 3067. 

[33] I. A. Batalin and G. A. Vilkovisky, Gauge Algebra and Quantization, 
Phys. Lett. 102B (1981) 27. I. A. Batalin and G. A. Vilkovisky, Quantiza- 
tion of Gauge Theories with Linearly Dependent Generators, Phys. Rev. 
D28 (1983) 2567; Errata: D30 (1984) 508. I.A.Batalin and I.V.Tyutin, 
On Possible Generalizations of Field- Antifield Formalism, Int. J. Mod. 
Phys. A8 (1993) 2333. J. Gomis, J. Par is and S. Samuel, Antibracket, 
antifields and gauge theory quantization, Phys. Rept. 259 (1995) 1-145, 
[arXiv 9412228 [hep-th]] M.Henneaux and C.Teitelboim, Quantization of 
Gauge Systems, (Princeton University Press, Princeton, 1992). 



80 



